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Preface 


In Indian universities the emphasis at the undergraduate level has 
been much more on calculus than on linear algebra and matrix theory. 
Today, however, the need for linear algebra and matrix theory as an 
essential part of undergraduate mathematics is recognised. The Bi> 
national Conference in Mathematics Education and Research (June 1 973) 
recommended Elementary Linear Algebra as a compulsory course for all 
students at the undergraduate level. It has since been generally agreed 
that before a studept begins to specialise in the discipline of his choice — 
whether it be mathematics, science, engineering, social science, or 
management— be must be exposed at least once to both calculus and 
linear algebra; such an exposure will familiarise him with the concepts 
and techniques of continuous mathematics (calculus), and the concepts, 
methods, and logic of modern discrete mathematics (linear algebra). 

This book is the outcome of a planned effort to teach linear algebra as 
a second course in the mathematics curriculum introduced at the under- 
graduate level several years ago at Birla Institute of Technology and 
Science (BITS), Pilani The students who take this course have had a 
semester of elementary calculus and analytical geometry. However, a 
knowledge of the fundamental properties of continuous and differentiable 
functions in terms of their addition, scalar multiplication, and multipli- 
cation is sufficient for an understanding of this volume. 

The treatment throughout is rigorous yet lucid. The fact that the 
minority of students who would use this text may not ultimately become 
mathematicians or physicists has not inhibited our development of the 
subject. We strongly believe that present-day users of mathematics, 
instead of being content with a hybrid of mathematical tools and 
gymnastics which merely graze the subject, should delve deep by training 
in concrete matter-of-fact arguments. The conceptual firameworic of linear 
algebra and matrix theory provides the most efficient means for this 
training; for, in one sense, matrices and linear equations form a concrete 
foundation, and vector spaces and linear transformations give the flavour 
of the abstract grandeur of modern mathematics. At the same time, as the 
freshmen we are addressing may not have had any grounding in abstract 
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mathematics, we have made a special effort to smoothen their first 
encounter with methods of proof. 

Theorems are proved in full (the end of proof is indicated by |), except 
in rare cases where they are beyond the scope of the book. In these 
instances the student is suitably instructed. Where certain consequences 
of earlier results are stated as FACTS, the student will find he has been 
sufficiently equipped in advance to prove them himself. The large number 
of worked-out examples which have been woven into the text help the 
student to move back and forth from the concrete to the abstract. The 
sets of problems — numerical, objective, and theoretical -interpolated at the 
end of almost every article are a drill on the text. Answers to the 
numerical problems appear at the end of the book; the objective questions 
which are of the “true- false” type are intended to help the student in a 
self-assessment of his conceptual understanding of the subject under 
study. 

Chapter 1 deals with sets and functions and gradually introduces the 
lan guag e of modern mathematics. A teacher may adjust his puce in thvs 
chapter to suit the standard of his class. Algebraic structures, such as 
groups, rings, and fields, have been discussed only to the extent needed. 

Chapter 2 provides the concrete geometric structure of 2- and 3-dimen- 
sional vector spaces. It leads the student to the problems of geometry 
through vectors and prepares the ground fur Chapter 3 which gets into 
the essence of the subject. Here the theory of vector spaces, and the con- 
cepts of linear dependence and linear independence, dimension and basis 
are treated elaborately. Though infinite-dimensional vector spaces are 
also considered, the emphasis throughout is on finite-dimensional vector 
spaces. 

Chapter 4 aims to familiarise the student with the fundamental pro- 
perties of linear transformations. The rank-nullity theorem and its 
consequences are presented in detad. The theory developed so far is 
applied to operator equations and, in particular, to differential equations. 
This application discloses that the solution space of the n-th order normal 
homogeneous linear differential equation is an n-dimensional subspace of 
the space of n-times continuously differentiable functions. The further 
application to the theory of ordinary linear differential equations is detail- 
ed in the Appendix. However, we have not attempted to make the 
treatment of differential equations self-contained. 

The elaborate build-up on vector spaces and linear transformations 
begins to pay dividends in Chapter S which starts by establishing the link 
between linear transformations and matrices. In our experience, the 
welter of mathematical detail on matrices in this chapter is easily assimi- 
lated by tile student because of the knowledge of linear transformations 
he has gained in Chapter 4. He is thrilled to see that the elementary 
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(apparently trivial) row operations on matrices finally result in the solution 
of linear equations in all their ramifications. Naturally, the chapter ends 
with matrix inversion. 

Now the student is ready for determinants, presented in Chapter 6. 
When he comes to determinant minors and the rank of a matrix he realises 
the importance of the emphasis in Chapter 3 on the concept of linear 
dependence and linear independence. The theorem giving the connection 
between the rank of a matrix (already defined in Chapter S by means of 
independence concepts) and the ordet of its nonzero minors is the crux of 
the content here. The ease with which it is proved justifies the efforts 
taken in the development of the subject in earlier chapters. Applications 
to linear equations, and a brief account of eigenvalues and eigenvectors of 
matrices, Wronskians, and the cross-product in Vg give an idea of what 
determinants can do. 

Chapter 7 gives a glimpse of the theory of orthogonal and unitary 
matrices, similarity transformations and their application to the geometry 
of quadrics. When the student reaches this chapter, he easily recognises 
the connection between linear algebra and geometry. 

The student should guard against conceptual errors of three types : 
‘finite dimension’ versus ‘infinite dimension’; ‘real scalar’ versus ‘complex 
scalar'; and 'non-empty set’ veisus ‘empty set'. When in doubt regarding 
hypotheses he should invoke what may be called an ‘emergency axiom’ : 
The suitable alternative in each relevant pair(s) is included as an additional 
hypothesis. 

The text can be adapted to suit different curricula : as a one-year 
course running three hours a week; as a one-semester course running five 
or six hours a week (as is the practice at BITS); or, by a judiciotis selec- 
tion of topics, as a onesemester course running three hours a week. It can 
be used during any year at the undergraduate level or as part of a first 
course in linear algebra at the postgraduate level, if no matrix theory has 
been done till then. However, as the topics have been arranged sequen- 
tially, any student who wishes to change the order of topics will need 
guidance. 

We wish to thank Dr. C. R. Mitra (Director, BITS) and others at BITS 
who encouraged our efforts in writing this book under the Course 
Development Scheme and provided all the necessary assistance in dupli- 
cating and class-testing its earlier versions over a period of thrde years. To 
the BITS students — about 1200— of these three years, we are als6 indebted 
for their lively response to our experiments in pedagogy. 

We are grateful to Messrs. G. R. Verma and B. L.,Soni who patiently 
typed the several drafts; Mr. A. P. Rastogi who drew the illustrations; and 
the National Book Trust, India, for subsidising the publication of the 
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book. To Mrs. J. Fernandes of East*West Press, our appreciation and 
thanks are due for a thorough editing of the manuscript. 

Our last words of affectionate gratitude are reserved for our wives and 
family members who continually cheered our years of effort at the project. 
We shall welcome all suggestions for improvement of the book. 


V. Krishnamurthy 

Pilani V. P. Mainra 

September 1938 J. L. Arora 



Chapter 1 


Sets and Functions 


We shall begin with a discussion on ‘sets’. Immediately, we get into 
the first requirement of mathematics, viz. proper definitions for 
technical terms. A major concern of mathematics is precision not only 
in the calculations of quantitative information, but also in the communi- 
cation of thought. This is why importance is given to definitions in 
mathematics. In this book we shall come across a large number of 
definitions. Each definition will introduce a new technical term or a new 
concept in terms \of preceding definitions. The very comprehension 
of a definition may often depend on the logical development of the subject 
up to that point. 

However, the first technical term, namely, ‘set’ will be introduced 
without a precise definition. The reason is obvious : The moment we 
attempt to define ‘set’, we get into words such as ‘collection’ or ‘aggregate’, 
which themselves need to be defined. We have to draw the line some- 
where ! 


1.1 SETS 

The meaning of ‘set’ is intuitively imderstood as a well-determined 
collection of objects, called its ‘members’ or ‘elements’. The objects 
(members or elements) are said to ‘belong to’ the set or to be ‘in* the set. 
Here all the words in quotation marks are taken to be undefined terms. 
To illustrate the meaning of ‘set’, let us consider some examples. 

Example 1. 1 The collection of the three boys : Arun, Mohan, and Ram. 
Example 1,2 The cdlection of the three symbols : A, □ and Q. 

Example 1,3 The collection N of ail natural numbers. 

Example 1,4 The collection Z of all integers. 

Example 1.5 The collection Q of all rational numbers. 

EjotmpU 1.6 The collection R of all teal numbers. 

Example 1.7 The collection of all the past presidents of Itadia. 

Exaapk 1.8 The collection of all the first year students of Birla Institute 
of Technology and Science (BITS). 
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Example 1.9 The aggregate of the living men in the world whose height 
exceeds 2 metres. 

Example 1.10 The aggregate of the roots of the equation x** — 1 0. 

Example 1.11 The aggregate of the integers that leave a remainder! 
when divided by 5. 

Example 1.12 The group of cricketers who were out for 99 runs in a 
lest match. 

Example 1.13 The collection of all positive primes. 

Example 1.14 The collection of derivatives of all orders of the function 
e*. 

Example 1.15 The collection C of all complex numbers. 

All these are examples of sets. We can construct several such exam- 
ples. Let us now consider two colleciions which are not sets : 

■ (i) The collection of some natural numbers. 

(ii) The collection of the politicians of India. 

In (i) it is not clear which numbers are included in the collection. 
Whether the number 2 is in the collection or not cannot be answered 
without first explaining the word ‘some'. Again, in (li) the question 
whether a specific person is a politician or not would get different responses 
from different persons. Thus, collections (i) and (ii) are not ‘well deter- 
mined’. 

In contrast to these two examples it is worthwhile to analyse Examples 
1.12 and 1.13. In Example 1.12 we note that every cricketer is either in 
the group or he is not in the group. We do not have to check any records 
to say this. In Example 1.13, again, either a number is a prime or it is not 
a prime. Here it matters little whether it is known that a particular number 
is a prime or not. In other words, it is immaterial whether we can 
answer the question : Is this particular object in the given collection or 
not ? What matters for specifying a set is to know unambiguously that 
only one of the two answers is ^ssible ; The object' in question belongs 
to the given collection or it does not belong to it. 

Thus, we can elaborately describe a set as a collection of objects 
which is well determined in the sense that, for every object, there should 
be only two possibilities available unambiguously ; either it belongs or it 
does not belong to the collection. 

If is a set and x is an element of A, then we write x £ ^4 (E is read 
as 'belongs to’ or ‘is in’ or 'is an element oP or 'is a member of’). The 
negation of this is denoted by x ^ ^ is read as 'does not belong to’ or 
Is not in’ or ‘is not an element oP or 'is not a member of’). 

/nstead ofsttch a detailed description of sets, two kinds of symbolic 
descriptions are very often used. One is by listing, if possible, all the 
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elements of the set within braces, e.g. sets of Examples 1.1 and 1.2 are 
respectively written as 

{Arun, Mohan, Ram} 
and {A, □, fi} . 

The other is by using a dummy element, say x, and writing the character- 
istic properties of x which precisely make it an element of the set. Thus, 
the set of elements characterised by the properties, say /*, 0 , ..., is written 
as 

{a I X satisfies P, Q, ...} 

or {.V : X satisfies P, Q, ...} . 

(* I * and * : ’ are reed as ‘such that*.) Thus, the sets in Examples l.Il and 

1.12 may respectively be written as 

(x I jc is an integer and x *=■■ 5k + 2 for some integer k) 

, f X is a cricketer who was out for just 99 runs! 

and s* : • . . > 1 . r • 

[ in a test match J 

Note that in the first method the order in which the elements are listed 
is immaterial. Thus, {Arun, Mohan, Ram} and {Mohan, Arun, Ram} are 
the same sets. We shall make this precise by defining the equality of 
sets. 

1.1.1 Definition Two sets A and B are said to be equal if every member of 

is a member of B, and every member of R is a member of A. In 
such a case we write A — B. 

For example, {0, 1, 2, 3} = {2, 1, 0, 3}. Also Z = {x | x is an in- 
teger} = {..., “3, —2, I, 0, 1, 2, 3, ...}. 

1.1.2 Convention All our definitions are *if and only if’ {iff) statements. 
For example, if a definition reads ‘A triangle is said to be equilateral 
if all its sides are equal’, we actually mean that ‘A triangle is said to 
be equilateral iff all its sides are equal’. 

In<view of this convention. Definition 1.1.1 means that two sets A and 
B are said to be equal iff every member of ^4 is a member of B, and every 
member of J3 is a member of A. . 

SUBSETS 

Let A and B be two sets such that every member of A is also a member 
of B. Then A is said to be a subset of B. In symbols we write A C B 
CC* is read as ‘is a subset of’ or ‘is contained in’). Whenever A is. a 
subset of B, we also say that R is a superset of A. In symbols we write 
BOA (*D* is read as ‘is a superset of* or ‘contains’). ’ 

Obviously, every set is a subset (superset) of itself. 
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Exercise Prove that A Biff A C B and B C A. 

This exercise is immediate and the reader can prove it himself. In 
practice, whenever we want to prove that two sets A and B are equal, we 
prove both the inclusions, i.e. A C B and B C A. 

EMPTY SET 

Consider the set of women presidents of India elected before 
31st December 1974. There was no such woman president. So this set 
has no members in it. Such a set, i.e. a set containing no elements in it, 
is called an enyrty set or a null set. It is denoted by 4 . 

It may be noted here that there is only one empty set. As a clarifica- 
tion of this, note that the set {x : x is a real number satisfying x* + 1 = 0} 
is also empty and we can write 

The set of all women presidents of India elected before 
31st December 1974 

= {x : X is a real number satisfying x® -f- 1 — 0). 
The set {x : x is a real number satisfying x* -f x 0} consists of only 
one member, namely, zero. So this set can be written as {0}. Note that this 
is not the empty set. 

Nonempty sets that consist of only a single member are called singletons. 
The set in Example 1.14 is a singleton as itconsists of only one element e". 
It would be interesting (at least for cricket fans) to find out whether the 
set in Example 1.12 is empty or a singleton or has more members than 
one. 

Finally, we note that ^ C ./I for all sets A. Thus, given a set A, it has 
two extreme subsets. One is A itself and the other is Any subset 
of A other than A and ^ is called a proper subset of A. 

Problem Set 1. 1 

1. Let A, B, and C be three sets such that A C. B and B C C, Then prove 
that ACC. 

2. Let iSj^, i$|, ..., Sf^ be n sets such that^^ C C ... C and S',, Cl S|. 
Then prove that Sj = S, = • • • =#5,. 

3. Prove the exercise given on page 3. 

4. Determine the set of real numbers x satisfying the following : 

(a) x» < 1 (b) x(x -i- 1) <0 (c) ^ 0 

(d) X* - 4 > 0 (e) (X* 4- 2)(x* - 1) > 0 (0 Jf + 1 < x. 

S« Determine the set of complex numbers z satisfying the following : 

(a) I X I < 4 (b) }" {• " * jzl|| ^ * 
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(d) rF+2z + 2z-5 « 0 (e) 2ir 4 2?+ 5 * 0. 

6. Determine all the subsets of the set : 

(a) {0, 1, 2} (b) {«, p. Y, «}. 

7. Let JT be a set containing n elements. What is the total number of 
distinct subsets of X"! 

8. Determine whether each of the following statements is true or false 
(N, Z, Q, and Ratt defined in Examples 1.3, 1.4, 1 5, and 1.6, res* 
pectively) : 

(a) NCQ. (b) {N, Q. Z) C R. (c) N C {AT}. 

(d) Ne{N,Q,Zi (e) RC{N,Q,R}. 

9. Given = {0, 1, 2, 3, 4}, 5 -= {jc e /V|xr < 10}, C ^ {x G /?1jc<10}, 
determine whether each of the following statenients is true or false : 

(a) AC B. (b) BC C. (c) C C A. 

(d) 1 A (e) -IGA (f) -IGC 

(g) 3 G A (h) C C B. (i) fl = C. 

1.2 OPERATIONS ON SETS 

The standard operations on sets, which yield new sets from old ones, 
are (i) union, (ii) intersection, and (iii) complementation. 

Given two sets A and B, the union of A and B, written as .4 U A is 
defined as 

A \J B = {x \ X C A or X C B} . 

Here ‘x G A or x C B* means x is in ^ or in B or in both. Throughout 
this book the word ‘or’ will be used in the inclusive sense as here, except 
when otherwise stated. 

The intersection of two sets A and B, written as A B, is defined as 
i4n5 = {x(xG^ ond x G B) . 

The complement of B in A, written as ^4 \ B, is defined as 
A \ B {x|xG-4 and x iff B} . 
i4 \ B is also denoted by C.i(B). 

Example 1.16 Let ^ - {1, 2, 3, 4, 5, 6} and B = {0, - 1 . 2, -3, 4, -5, 6}. 
Then 

^ U B = {-5, -3, -1, 0, 1, 2, 3, 4, 5, 6} 

^ n B =. {2, 4, 6} 

A \ B =. {1, 3, 5) and B \ i4 - {0, -1, -^3, -5) . 

The geometrical illustrations in Figure 1.1, called Venn diagrams, are 
hdpfbl in understanding these opmttions. 
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The shaded part represents 
A n B 



The shaded part represents 
A U B 


A 



The shaded part represents 
A\B 

Figure 1.1 



The shaded part represents 
X \ A .f A c X 


CARTESIAN PRODUCT 

Let A and B be two sets. Consider the set of all ordered pairs (x, >'), 
where x & A and y & B. This set is called the cartesian product of sets 
A and B, written as ^4 x In symbols we write 

A X B = {{x, y')\x^ A, y ^ B) . 

Example 1,17 Let A = {1, 2} and B = {x, y, z}. Then 

Ax B ^ {(1. x\ (2. x), (I, y), (2, y), (1, z). (2, z)} . 

Example 1.18 Let J? be the set of real numbers. Then Rx R (also written 
as /?*) is the set of all ordered pairs (x, y\ where x and y are real num- 
bers, that is, 

Rx R ^ {(x, >>) 1 X, are real numbers} . 

Geometrically. R represents the set of points of a straight line (called 
the real line), and R X R represents the set of points of a plane. 

Problem Set 1.2 

1. Let A, B, and C be the sets as defined in Problem 9 (Problem 
Set I.l). Determine 
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(a) A\J B (b) /j n fl (c) A nc 

(d) B IJ c ie) A\B {{) B\C 

(g) C\A (h) ^ < B. 

2. Let .1 - [0, 1. 2, 3, 4), B ^ & N \ x < 20}. 

(’ - [a £ ^ I A 3}, D = j A IS diMSible by 7}. 

Determine 

(a) /< I J (b) /( o /> (c) S n C 

(d) B n D (c) A , iC (f) A D 

(g) A \ B (h) A \ /) O' B\C 

(j) B \D (k r \ D 0) A \ B. 

3. If the sets i?, C, and D are a-, defined m Problem 2. then deter- 
mine whether each of the following statements is true or false: 

(a) Bi C D. tb) A .. B. (c) A C C. 

(d) A \ ^ D - 4>. fe) .4 r <- r B (f) C\A C D. 

4. Let A — {u, p, y}, B <=■- rt, 0}, C 'i",'/. Determine 

(a) A '< B ih) A y C (c) x C. 

5. Dcicnbe )he following subsets of R 

(a) |y I \ > 7) i, ) (a 1 ,v < 0} (b) fx I x > 1} U {x j x < 1} 

^c) <x 1 A - 1} j i X 1} (d) (v 1 A > -i; n {a 1 A < 1} 

(e) {a 1 A < - 1 J r 1 (a ! A > 1 } ff} {a 1 A > 1 1 n {A 1 A > 0}. 

6. If A, B, C, and D are any sets, prove that 

(a) (/4 X 5) n (C X D) = (A f'l C) X {B n D) 

(b) {A ' B) J(C X D) C U C) X (5 U D). 

7. Give an example in which 

{A X B)\J {C X D)^ (A \J C) X {B U D) 

8. If A, B, and C are any sets, prove that 

(a) ^ u (fi n C) = {X u 5) n u c) 

(b) .4 n (if U C) = {A n B) U {.A D C) 

(c) ^ U (5 U C) = {AkjB) U C 

(d) ^ n (fl n c) = M n n c. 

9. Prove DeMorgan’s Theorem : 

If A and B are both subsets of a set 5, then 

(a) S\(y4 U il) - (S\ n (5\ B) 

(b) 5\ M n 5) * (S\^) U (S\il). 

10. True or false ? 

(a) If A and B are two sets, .d n -B is the largest subset of i4 U B, 
which is contained in both A and B. 

(b) If A and B are two sets, 4 U B is the smallest superset of ^4 n B, 
which contains both A and B. 
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(c) If A is nonempty, 4 \ B can never be empty. 

(d) The union of two intervals in R is an interval. 

(e) AxB is not equal to B x A. 

(0 This text has not yet given the definition of an infinite set. 

(g) This text has not yet considered an infinite set. 

(h) R X R is the set C of complex numbers. 

1.3 RELATIONS 

Let be a nonempty set. A subset Ji of Ax A is called a relation 
on A. If {x, y) G we say * is related to y by the relation 3! and 
symbolically we write x Jl y. For example, 31 = {(1, 2), (1, 3), (2, 3)} 
defines a relation on the set = {1, 2, 3}. Here 1 3t 2, 1 31 3, 2 31 3. 
Obviously, it is the usual relation *<’, because 1 < 2, i < 3, 2 < 3. On the 
same set A, the relation is described by the set {(1, 1), (1, 2), (1, 3), 
(2. 2). (2. 3), (3. 3)). 

We note that *<’, ‘=’, *>’, etc., are relations on/?, N, Z, and Q. 
Ts the mother of’, ‘is the brother of’, ‘is married to’ are relations on the set 
of all human beings. 

1.3.1 Definition Let 31 be a relation on a set A. 

(a) If 31 ^ (i e. (x, x) G 3!), for every x G ^4, 3t is said to be a 
reflexive relation, 

(b) If, whenever x 3! y, it is also true that y 31 x (i.e. whenever 
(X, y) G 31, (y. *) also belongs to 31), 31 is said to be a symmetric 
relation, 

(c) If, whenever x 31 y and y 31 z, it is also true that x 9t z (i.e. if 
(x, y) G 91 and (y, z) G 91, then (x, r) G 91), 9? is said to be a 
transitive relation. 

(d) A relation 91 on ,4 that is reflexive, symmetric, and transitive is 
called an equivalence relation on A. 

We shall consider several examples of relations. 

Exanqtle 1.19 Let Z, the set of all integers Consider the subset 9t 
of Z X Z defined by 

91 = {(*» y) : X — y is divisible by 3} . 

Here x 91 y #(x— y) is divisible by 3. 

(a) 91 is reflexive, because x— y is divisible by 3 for every integer x. 

(b) X'-y is divisible by 3 clearly means y— x is also divisible by 3. 
Hence, x 9t y implies y 91 x. So 31 is symmetric. 

(c) If x—y is divisible by 3 and y— z is divisible by 3, it is certainly 
true that x — z ■■ (x — y) + (y -- z) is also divisible by 3. Thus, x 91 y 
and y 91 z imply x 9| z. Hence, 9t is transitive. 
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Therefore, St is an equivalence relation. 

Example 1.20 Let A => It, the set of real numbers. It is obvious that *»’ 
i^is an equivalence relation. 

^Example 1.21 Define the relation 31 on Z \ {1} by saying x^ly {ff x and 
hqye a common factor other than 1. This relation is reflexive and 
sylfiirietric, but not transitive. 

Example 1.22 On Z, define x 91 to mean x>y. This relation is neither 
reflexive nor symmetric, but it is transitive. 

Example 1.23 On Z, define x 91 to mean x This is reflexive and 
transitive, but not symmetric. 

Example 1.24 On Z, define x 91 y to mean x ^ y + 1. This relation is 
reflexive, but neither symmetric nor transitive. 

Example 1.25 On Z, define x 91 y to mean x = — y. This relation is neither 
reflexive nor transitive, but it is symmetric. 

Example 1.26 On the set F of all fractions of the form alb with a, 6 0, 

define ajb yi cjd iff b = c. This relation is neither reflexive nor symmet- 
ric nor transitive, v 

Example 1.27 Let A be the set {1, 2, 4, 6, ...}. Define the relation 91 by 
saying xyiy iff x and y have a common factor other than 1. This rela- 
tion is symmetric and transitive, but it is not reflexive, because 1 91 I is not 
true. 

Example 1.28 On C, the set of complex numbers, define z 9t w to mean 
Re (z) < Re (w) and Im (z) < Im (tv). It is reflexive and transitive, but 
not symmetric. 


Problem Set 1.3 

1. Determine whether each of the relations defined below on the set 
S is reflexive, symmetric or/and transitive Pick out the equivalence 
relations. 

(a) x3ly x<y + 1 : S = R 

(b) X 31 y X = 2y : S = 0 

(c) X 91 y — y is divisible by 2 : S Z 

(d) X 31 y <» X h the brother of y : 5 is the set of all human beings 

(e) X 3? y o * C y : 5 is the set of all subsets of R 

(0 X 31 y •«» X is married to y : 5 is the set of all human beings 

(g’ixRy^s.x-lyltS-R ' 

(h) X 31 y ■«» X — -y : S = 0 

(i) xJly *> sinx «- siny : S = R 

(j) z3|Tv-e>lzl-|ivi:S-C 

(k) X 91 y ■«>' X and y are students of BITS ; 5 is the set of all 

students of India. 
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L4 FUNCTIONS 

The reader mitst have already been exposed, in his earlier training, to 
a proper definition of functions and operations with functions. However, 
as the concept of a function is very fundamental to mathematics and its 
applications, we shall now give the basic ideas about functions relevant 
to our subject. 

1.4.1 Definition Let A and B be two nonempty sets. A function (map) 
f from >4 to .0 IS a rule which, to each element of A, associates a 
unique element of B. Symbolically, we write 

f-.A-^B. 

For each x S A, the unique element of B associated with * is denoted 
fix) and is called the image of x by (under) f or the fimage of x or the 
value of f at x. We also say that x is mapped into f{x) by /. x itself is 
said to be a pre-image of/(x) under /. A is called the domain of /written 
as D(f). It is the set on which f is defined. B is called the target set of/. 
It is the set to which the images belong. 

For clarity, we often draw a diagram as in Figure 1.2. 



We shall set up a number of conventions on usage, by means of a 
simple example of a function : Consider the function f:R~*-R defined by 
the rule, which, to each x G 0, associates the value x-. So f(x) = for 
all X £ 0. By abuse of language, we sometimes say that the function is x^, 
and we even use the symbol /(x) for the function. Very often, we use the 
more precise language that the* function is given by /(x) »= x*, x £ R. 
Alternatively, we denote this function as the set {(x, x*) I x £ /^ of or- 
dered pairs. This set is also called the graph of the function; because, if 
we plot the points (x, x") in a plane, we will get the geometrical curve 
representing the function. 

We shall now illustrate the foregoing ideas by listing seven ways of 
expressing this xAfunction. The first four methods are technically perfect, 
and methods (v) to (vii) are sanctified by custom and usage. 

(i) fiR-^R defined by x x*. 

(u) 'fix for all x £ 0. 
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(iii) /: R-i -*■ R defined by/i[ac) = **. 

(iv) /= {(x,.v») 1 -T e /?}. 

(v) The function x* defined on R. 

(vi) The graph of the function is {{*, J x £ R). 

(vii) The graph of the function is as in Figure 1.3. 



Note that the symbol >->’ used in (i) and (ii) is different from the 
symbol for a function. The symbol is used when w'e want to 
specify the domain and target set of/, whereas ‘t— »■’ is used when we want 
to indicate the image of a single element of the domain. Thus, x }—*■ ** 
means that the image of x is x". On the other hand, when we write 
f: A B, Vie are not specifying the image of a single element. 

Though we shall allow ourselves the liberty of using any of these 
methods to specify a function, in the sequel, more often than not, we shall 
adhere to methods (i), (ii), and (ii'i). In case there is doubt while using the 
other methods, the reader should go back to the first three methods for 
clarification. 

It may be noted that, if it is possible to list, without ambigdity, all the 
values of /(x) as x varies in the domain, we do so, and w’e alsu say that 
this list is the function. 

Now we emphasise the word ‘unique* occurring in fhe definition of a 
function. For each x £ A, J(x) should be unique. In other words, / 
cannot have two or more values at a given x. For example, i{ A {1, 2, 
3, 4, 5} and B (—1, 2, —3, 4, —5, 6, 0}, then the association 1 1— ► — 1; 
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2 f-*- 2 and 0; 3 —3; 4 >-> 0, S i— >■ — 5 is not a function, since the 

image of 2 is not unique. 

Exampie 1.29 ^ {1, 2, 3, 4, 5. 6} and il - {-1, 2, -3, 4, -5, 6, 0}. 

Define /: A-* Bby saying /(I) = — 1,/(2) = 2, /(3) = —3, /i4) ■» 4, 
J(5) =» —5, and f(,6) = 6. This function is nothing but {(I, — 1). (2, 2), 
(3, -3), (4, 4). (5. -5), (6. 6)}. 

Example 1.30 Given A and .0 as in Example 1.29, define f:A-*Bis 

follows : /i:i) - -l./(2) = 0,/(3) =-• -3. /(4) = 0,/(5) 5, m =* 0. 

This function is nothing but {(1, —1), (2, 0), (3, —3), (4, 0), (5, —5), 

( 6 , 0 )}. 

Example 1.31 Define f:R-* Rbyf(x) = | x | . This is called the absolute 
value function. 

Example 1.32 Define f:R^-*Rby f{Xi, x^) =* Jfi + **. To each point 
(Xi> Xf) in R?, this function associates the real number x^ 4- Xg. In other 
words, to every pair (x, j?) of real numbers, this function associates their 
sum X + y. Therefore, this function is called addition in 0. 

Example 1.33 In the same manner as in Example 1.32, multiplication in 
R can be written &sf:R‘-*-R defined by/|[Xi, x,) *= XiX,. 

Example 1.34 Fix a real number A. Then/; x t— >■ Ax for all x £ 0 is a 
function, called (scalar) multiplication by A. 

Exan^le 1.35 Let a be a fixed real number. Then /: x i— »■ x + a for all 
X £ 0 is a function, called translation by a. 

Example U6 f : xt— > 0 for all x £ 0 is a function, called the zero func- 
tion or the zero polynomial on 0. It is denoted by 0. Note that f{x) = 0 
for all X £ 0 and its graph is just the x-axis. 

Exafnple 1.37 Let A and B be two nonempty sets and hg £ 0 be a fixed 
element. Then the function/: A-* B defined by/[x) — h, for all x £ if 
is called a constant function. Note that Example 1.36 is a special case of 
this function. 

Example U8 The function/: A-*- A defined by /(x) x for all x £ if 
is called the identity function on if and is usually denoted by I a . 

Example 1.39 Let n be a nonnegative integer and a^, Oi .... a„ be fixed 
elements in 0. Then the function 

0 ; X !-► «0 + OiX + ... 4 OnX* , X £ 0 , 

s called a real polynomial flmetion on 0 or simply a real polynomial on 
0. Note that it is a map from 0 to 0. By abuse of language, Oo + OiX 
4 ... + OmX” itself is called a polynomial. To denote the fact that 
Of, Oi, ..., a* are real, it is also called a polynomial with real coefficients. 

If 96 0, then it is said to be the dlegree of the polynomial a, 4 
4 ... 4 The set of all real polynomiab is denoted by 9, and the 
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wt >11 real polynomiab of degree oot tlun * i> denoted tqr 
Note that the zero polynomial, 0, belonga to both 9 and The degree 
of the zm polynomial is, Iqr convmitioo, assigned to be — oo. Similarly, 
P‘.C-*C given by p(*) “ a» + «!«+... + vhere o», Ot. — . «• are 
complex numbets, is called a complex polynomial on C. 

Exan^le 1,40 Define/: 9^*- it by flp) — p(0) for all p € For ins* 
tance, if the polynomial Is p : x i— ► 2x* + 1. then flp) « 1. Note that 
this is not a constant function. (Why H) 

Example 1.41 Let ilf be the set of natural ’numbers. Then any ftmction 
f: N-*-R can be written asthe set of ordered pairs {(l,/|[l)), (2, y(2)), 
(3,/(3)), Such a function is called a seqtunee of real numbers. The 
sequence is also written as 

m, A2), /(3). ... 

For instance, 2, 4, 6, 8, ... is a sequence. It is just the function xt~^ 2x 
on N. 

In the discussion of any function /, there are four fundamental quea* 
tions : ^ 

(i) What is the domain of /? 

(ii) What is tli% range of / ? 

(iii) Is the function *onto’ or not ? 

(iv) Is the function ’one-one' or not ? 

We have already introduced the domain of /. We shall now introduce 
the concepts related to other questions. 

1 . 4.2 Deflnithm Let / : i4 ^ be a function and y E A The pre^image 
of y is the set {x € ^ I A*) “ y}- 

1 . 4.3 Bemaifc An accepted notation for the pre-image of yunder/is 
/'^(y). However, we shall not use this notation in this sense. 

Example 1,42 Define f'.R-^'Rhy the rule/(x) » x*. The pre-image 
of 4 is {2, —2}, and the pre-image of 0 is {0}. The pre-image of —1 is 
the empty set f . 

1 . 4.4 Definition Let /: -«■ if be .a function. The set { A >) : x E ^1) is 

called the range of /and is dmtoted by Ri,f). 

It is in fact the set of all/-images. 

1 . 4.5 Definition A map / : A.-*B is said to be onto (sutjqctive) if 

■R(/) - A 

Clearly, the following statement is true. 

1 . 4.4 Fact A map/: it JB is onto W either one of the foUowing propro- 
ties holds : 

(a) For every pEF; time exists at least one xE A such that 

/W-J'. 


(I) 
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(b) For every y & B, the pre*image of y is a nonempty subset 
ofil. (2) 

The proof of this fact is left to the reader. 

We now consider Examples 1.29 to 1.41 with reference to the foregoing 
definitions. The function / : x ->■ x* from to J? is not onto, because the 
negative real numbers have empty pre-images. 

In Example 1.29 /!(/) — \ {0}. So /is-not onto as also the function 

in Example 1.30, because , 

Rif) = {-1. -3. -5, 0}. 

In Example 1.31 it(/) — {x I x > 0}. So /is not onto. But in Example 
1.32 the range is Jl, since every number in R can be expressed as Xi-fx, 
for suitable real numbers Xj and X 2 in at least one way. Hence, the map 
is onto. 

The function of Example 1.31 is onto because the range is R- The 
reason is similar to the one gived for Example 1.32. 

In Example 1.34, if A 0, the range is R, because every number in R 
can be expressed as Ax for a suitable x in R. The map is onto in this case. 
If A s 0. the range is {0} and the map is not onto. 

In Example 1.35 the map is onto, since the range is R. (The reader 
should reason this out.)'*' But the map of Example 1.36 is not onto, as the 
range is {0}. This is an extreme case of a function not being onto. 

The map in Example 1.37 is, in general, not onto as the range is {bo}. 
It becomes an onto map if B is a singleton. In Example 1.38, since the 
range is A, the map is onto. 

In Example 1.39, unless p is specified, the range cannot be calculated. 
For example, the polynomial p : x i— »■ x -f- 1 is an onto function, whereas 
the polynomial q : x x* -|- 1 is not. (Why ?) 

In Example 1.40 the range is R (why 7), so the map is onto, whereas in 
Example 1.41 the map is not onto, because the range is {/(I), /(2), ...}. 
It is a proper subset of R. The proof of this is beyond the scope of our_ 
treatment. 

1.4.7 Definition A map f A -* B is said to be one-one (injective) if 
distinct elements of A are mapped into distinct elements of B. 

The function x t— > x*, x € Bis not one-one, because we can find several 
pairs of distinct elements Xi, x, that have the same image, e.g. both 2 and 
—2 map into 4. 

Clearly, the following statement is true. The proof is left to the reader. 

1.4»8 Vaet A map/: A-^^Bis one-one (Kf any one of three properties 
holds : 

(a) X ^ ye- fix) ^/(y). 

(b) Ax) mm Ay) ^ X •m y. 


(3) 

( 4 ) 
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(c) The pre-image of each element in the range of / is a single- 

« ton. ( 5 ) 

Note that whenever we want to prove that a certain function is one-one, 
we have to prove (3) or (4) or (5). 

1.4.9 Remark The name *one-one’ comes as follows : Already in the 
definition of a function, given x, J{x) is unique. The requirement 
of Definition 1.4.7 further assists that, given f(x), x is unique. 
Thus, the correspondence x f{x) is unique both ways. Such 
a correspondence is called a one-one correspondence. Hence the 
name one-one function. 

Let us now check which of the examples from 1.29 to 1.41 are one- 
one. 

In Example 1.29 the function is one-one. In Example 1.30 it is not, 
because the pre-image of 0 is {2, 4, 6}. 

In Example 1.31 /is not one-one, because for any x E. H, x and —x 
both map into the same image. 

In Example 1.32 /is not one-one, because a number can be expressed 
as the sum of two real numbers in more than one way. For instance, 
7=«3-|-4 = 5-i-2. So/ (3, 4) = 7 = /(5, 2). For a similar reason, the 
multiplication function of Example 1.33 is not one-one. 

In Example 1 .34, if X # 0, (scalar) multiplication by X is one-one, ly catise 

=» Xjfj se- *1 == which proves (4) in Fact 1.4.8. If X = 0, the map 
is clearly not one-one. 

In Example 1.3S translation by ‘a’ is a one-one map, because 
jf, -F o = xTi -I- a:»'Xi = :c,. 

The maps of Examples 1.36 and 1.37 are clearly not one-one, because 
all members of A are mapped into one member of B, In fact, this is the 
extreme case of not being one-one. On the other hand, the map of 
Example 1.38 is one-one. 

In Example 1.39 whether or not the function is one-one depends upon 
the polynomial, because the polynomial p:x !-»■ x -|- 1 is one-one, where- 
as the polynomial q:x !-*■ x* -f- 1 is not one-one. (Why ?) 

The map of Exan^^le 1.40 is not one-one, because (x-1-1) and (x*-|-l) 
have the same image. 

In Example 1.41 also the one-oneness depends upon the> sequence, 
e.g. the sequence 1, 1/2, 1/3, 1/4, ... is one-one, whereas the>. sequence 
1, 1, 1, ... is not one-one. 

L4.M Dcflnhton Two sets A and B are said to be in oite-one correspond- 
enee if there exists a aa^/: A-r^B that is one-one and onto. 

1.4.11 P sin iti qn If a set is in one-one cwieqwndence with the set 
fl. 2. fl). for some nositive intecer n. A is said to be a finite set. 
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Sets that are not finite are called infinite sets. 

For eumple, the set of all real roots of the equation *• — 2jc* — * + 2 
0 and the set of vertices of the triangle ABC are in one-one corres- 
pondence. Both are finite sets, since they are in one-one correspondence 
with the set {1, 2, 3}. 

N, Q, R, Z, and C are all infinite sets. (Why ?) 

Problem Set 1.4 

1. Determine which of the following subsets of R x R are functions : 

(a) {(1. 1). (1, 2). (1. 3). (1. 4). (1. 5)} 

(b) {(1, 1). (2. 1). (3. 1), (4, 1), (5, 1)} 

(c) {(!,*). (O.e). (e. 11} 

(d) (e. U}. 

2. For the given sets A and B, define, if possible, a function f: A-*- B 
such that (i) / is onto but not one-one, (ii) / is neither one-one nor 
onto, (iii) / is one-one but not onto, (iv) / is one-one and onto : 

(a) A = {a,b,c,d}, B - {0, 1. 2. 3} 

(b) A = {I, 2. 3}. B = {0, 1. 2, 3} 

(c) A = {0, 1. 2, 3}, B = {1, 2, 3} 

(d) A ^ R, B ^ R. 

3. Determine the largest subset ^ of it for the function f : A-*- R 
defined as follows : 

(a) /:x) = - 1) (b) fix) * V(4-Jc*) 

(c) f{x) = */(I +x) (d) fix) ^ x»-2x + 7 

(e) fix) - x/(** + 1) (0 fix) = Vix» - X*). 

4. Determine the largest subset A of C for the function / : A -* C 
defined as follows : 

(a) = I * I (b) fiz) z/ izl 

(c) fiz) ■= Re (z) (d) fiz) = exp(/ Im(x)) 

(e) fiz) — exp(Re(z)) (f) fiz) «= 7. 

5. Determine the range of each of the functions in Problems 4 and 5. 

6. Determine which of the functions in Problem 4 are one-one and 
which onto. 

7. True or false ? ' 

(a) There is a one-one correspondence between A x B and B x A. 

(b) There is a one-one correspondence between C and R x R. 

(c) If A ud B an finite sets, then every one-one map fiA-*S\» 
idaoontc. 
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(d) If A and B are finite sets, then every onto map / : 4-*- Bis 
also one^>ne. 

(e) A nonempty subset of a finite set is also finite. 

(0 Every nonempty subset of an infinite set is infinite. 

8. Determine which of the following graphs represent functions : 





1.5 BINARY OPERATIONS 

We shall now introduce a very important class of functions whidi in* 
eludes the familiar operations of arithmetic, namely, addition atRl multi- 
plication. If we look back carefully at the operation of addition of 
numbers, we find it is essentially a process of combining two numbers and 
obtaining another number in an unambiguous way. Thp same is true of 
multiplicatioiL A geiteralisation of this idea is the following d^nition. 

1.5.1 DsAsMob Given a nonempty set A, any function from A x Ato A 
is called a binary operation on A. 
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In other words, to each ordeited pair (x, y) of elements x and y of A, 
the binary operation * on A associates a uni^he element z of A. We 
write z X * y. 

The functions defined in Examples 1.32 and 1.33 are binary operations 
on R. But the (scalar) multiplication by a fixed A in Example 1.34 is not 
a binary operation on R, because it is not a function onR X R. It does 
not associate a number with every pair of numbers in R. 

Note that though addition is a binary operation on Rot Not Q or 
the set E of even integers, it is not a binary operation on the set of odd 
integers, because the sum of two odd integers is not an odd integer. We 
formalise this situation by the following definition. 

1.5.2 Definition Let BC A. Let « be a binary operation on A. If for 
each pair of elements (x, y) in B,xmy belongs to B, we say that 
B is closed under If there exist x,yinB such that x * y d; we 
say that B is not dosed under 

Note that the situation ‘B is (not) closed under ’ is sometimes 
referred to as ‘ is (not) a closed operation in B’. 

To illustrate Definition 1.S.2, let us consider a couple of examples. 
Example 1.43 The set of odd integers is not closed under the usual addi- 
tion of numbers, but it is closed under multiplication. 

Example 1.44 The set N is not closed under division, but it is closed 
under addition. 

The reader should note that unless B is closed under it cannot be 
a binary operation on B. We now give some examples of binary opera- 
tions. 

Exangtle 1.45 f : (x, y) i— »-x — y is a binary operation on R. It is also 
a binary operation on Q, Z, and C, but it is not a binary operation on N. 
Example 1.46 f : (x, y) }-* xjy is a binary operation on ll\{0}. We 
cannot have the whole set R here, because xjy is not defined when y == 0, 
It is also a binary operation on C \ {0}, Q \ {0}, but not onZ\ {0} 
otN. (Why?) 

Example 1.47 f : (x, y) x -f y — xy is a binary operation on C, R, 
Q, and Z, but not on N. (Why ?) 

Example 1.49 f '• (*. y) X* is a binary operation on N, but not on Z 
otQotR. (Why?) 

Example 1.49 / : (x, y) t--»- 1 x — y | is a binary operation on Q, Z, R, 
and C. 

1.5.3 Dcfiidtion A binary operation * on a set is said to be 
(a) eommutatire if a * h ■* h e a for all a. h £ ^1; 
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(b) associative if a '* (b * c) — > (a* b) * c for all a, b, c E A. 

Whenever **’ is associative, we can ^rite a *c in place of a* (b*c) 
or (a * b) * c. 

The usual addition and multiplication of numbers are both commuta* 
five and associative. The operations defined in Examples 1.4S, 1 46, and 
1.48 are neither commutative nor associative. But in Example 1.47 the 
operation is both commutative and associative. In Example 1.49 the opera* 
tion is commutative, but not associative. The reader should check these 
statements carefully. 

We shall not discuss nonassociative binary operations in this book, 
but we shall deal with some important noncommutative binary opera* 
tions. 


Problem Set 1.5 

1. Define addition ‘4-’ and multiplication * x ’ on the set S = {«, p, y) 
with the help of Tables 1.1 and 1.2. 

Tables 1.1 Table 1.2 


+ 

a 

p 

Y 

X 

« 

p 

Y 

a 

a 

p 

Y 

a 

a 

a 

a 

P 

p 

Y 

a 

P 

a 

P 

Y 

T 

Y 

a 

P 

Y 

a 

Y 

P 


Prove that the binary operations *+’ and ‘x’ as defined by these 
tables are commutative and associative. 

2. Define the binary operation on R, the set of real numbers, as 
follows : 

X * y =- xy X y. 

Is commutative ? Is *•’ associative ? 

3. Give an example of a binary operation, which is 

(a) associative but not commutative 

(b) commutative but not associative 

(c) neither commutative nor associative. ^ 

4. Define addition *+’ and multiplication ‘ x ’ in il x /£ as follows : 

(^ 1 . -T*) + CPi, “ (»i -f 3'i. Xt + y%) 

(*i, Xt) X (pj, p,) « (Xi yi, xt y^. 

Prove that these are commutative and associative binary operations. 
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given that (»*, *,) — O'i, y,) means x, = y, and x, = y,. 

5. Define the binary operations *+’ and *x’ on R x Ras follows : 

(^ 1 . ^i) + (yi. y») = ixi + y„ x, + y») 

(* 1 . JC.) X (y„ y,) ■= (x,y, - Xt>*„ x^y, + x,y,)- 
Prove that both these operations are commutative as well as associa- 
tive. (Equality is defined as in Problem 4.) 

6. Let Zff be the set of nonzero real numbers. Define addition *+* and 
multiplication ‘x’ on Z x Zas follows : 

(*i. X,) + (yu * (Xiy, + x,yi, x^,) 

(xi, X,) X (yj, y,) = (xiyi, x^*). 

Prove that these are commutative and associative binary operations, 
given that (Xi, x,) = (yj, y,) means x,y, = x,y,. 

1.6 ALGEBRAIC STRUCTURES 


HELDS 

The standard properties of real numbers with respect to addition and 
multiplication are so fundamental in mathematics that whenever any set 
X with two binary operations *+’ and (called addition and multipli- 
cation) satisfies these properties, we give a special name to such a system. 
It 4S called a field. To understand these properties, which are listed in 
the following formal definition, the reader is advised to think of X as the 
sqt JR of real numbers and the operations and *•’ as the usual addi- 
tion and multiplication in R. 

4.6.1 D^ition Let JIT be a nonempty set on which there are two binary 
operations ‘-F’ and *•’, called addition and multiplication, respec- 
tively. Then the set X together with these operations is said to be 
a field, if the following axioms are satisfied : 

FI Addition is associative. 

F2 There exists an element 0 € X with the property that 0 + a = d 
+ 0 "= a for all a E Z. 

F3 For each a E X, there exists an x E Z such that a -f- x >= 0 
*= X + a. 

F4 Addition is commutative. 

FS Multiplication is associative. 

F6 There exists an element 1 E X such that 1 ^a « a = a- 1 for all 
a EX. 

F7 For each o (:^ 0) in Z, there exists an element y E Z such 
that a-y — 1 K-y-a. 
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F8 Multiplication is commutative. 

F9 Multiplication is distributive o\er addition, that is, for all 
X, 

a - ib + c) = a • b + a - c 
and (a + b) ' c «= a • c + b • c . 

In the case of X R the element x mentioned in F3 is just the fami* 
liar —a, the negative of a, and the element y mentioned m F7 is just 
the familar 1/a, the reciprocal of a. 

Axioms FI to F9, which are valid in R, are fundamental. Starting from 
them, all the formulae of elementary algebra can be derived. 

The classical examples of fields are, besides R, 

(i) the set Q of rational numbers under the usual addition and multi* 
plication and 

(ii) the set C of complex numbers under the usual addition an'd multi- 
plication. 

In this book we shall be interested in only these three fields, namely, 
R, Q, and C. 

Z is not a field under addition and multiplication, because F7 is not 
satisfied. So also N is not a field. (Why ?) 

GROUPS 

Now we take up another structure in algebra, which is simpler than a 
field. Suppose we restrict our attention to only one binary operation on 
a nonempty set X and denote it by *+’. If this satisfies axioms FI, F2, 
and F3, we say that the system is a group. If, in addition, F4 is satis- 
fied, we call it a commutative group. We shall now give the formal defi- 
nition. 

1.6.2 Definition Let G be a nonempty set on which a binary operation *•’ 
is defined. Then G is said to be a group, under the operation if 
the following axioms are satisfied ; 

G1 '«* is associative. 

G2 There exists an element e € G such that e * a = a — a * e for 
all a & G. e is called an identUy for 

G3 For each a G G, there exists an element x £ G such that 
a*X3se<BX*a. xis said to be an inverse of a for the opera- 
tion **’. 

If, in addition, 

G4 The operation *«* is commutative, 

then the group is said to be commutative or abelian. 
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Let US consider four examples : 

(>) 6> and Z are groups under the usual addition operation. 

(ii) N, under addition, is not a group, because G2 and G3 are not 
satisfied. 

(iii) 6\{0} and il\{0} are both groups under the operation of usual 
multiplication. The number 1 plays the role of *e' in the definition. 

(iv) The set Z\{0}, under multiplication, is not a group, because G3 
is not satisfied. 

In all these four examples of groups the operation is commutative. .So 
they are all commutative groups. However, noncommutative groups are 
of great importance in mathematics and its applications. Watch for some 
examples of noncommutative groups as we go along. 

Before we proceed, we shall establish the uniqueness of the 'identity* 
referred to in G2 and the 'inverse* referred to in G3. 

1.6.3 Theorem (a) In a group G there is only one identity, i e, the identity 
is unique. 

(b) For a given element a in a group G there is only one inverse, i.e. 
the inverse of an element a E. G is unique. 

Proof: (a) Let e and e' be two elements in G, both having the 
property stated in G2, namely, 

e * a =3 a =: a * e for all a E G (1) 

and 

e'*a = 0 = 0*0' for all 0 E <7. (2) 

Then taking e' for o in Equation (I), we get 

e * e' = e' * e = e', 
and taking e for o in Equation (2), we get 

e' * e = e *e' = e. 


Hence, e e', i.e. the identity is unique. 

(b) Given o E G, let x and y be two elements in G, both having the 
property stated in G3, namely. 


a*x^x*a^e 


(3) 

and 

o*y = y*o^e. 


(4) 

Therefore, y =z y * e 

(byG2) 


= y*{o*x) 

(by (31). 


But the operation ‘** is associative in G. Hence, 

we get 


y — iy * a) *x 

a® e»x 

(by (4)) 


« X 

(byG2). 
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This proves that the inverse of each element is unique. | 

Thus, hereafter, we shall speak of the identity in a group G and also of 
the inverse of an element a E G* 

Whenever the operation is denoted by '+’, the identity is denoted by 
‘O’, and the inverse of 'a' is denoted by ‘—a\ It is customary to write 
o — h for fl + (-h). 

RINGS 

Another important structure is that of a ring. Let us once again 
consider the nine field axioms. The first four axioms— FI, F2, F3, and 
F4 — are pertinent to addition, whereas the next four axioms — FS, F6, F7, 
and F8 — are pertinent to multiplication. The ninth axiom, F9, pertains to 
both addition and multiplication. 

If there is one binary operation on a set and the four axioms FI to 
F4 are satisfied, then the system is a commutative group. If a set AT has 
two binary operations and' all the nine axioms are satisfied, we say the 
system is a field. Id between these two situations, we have a ring 
structure. 

Suppose a set X has two binary operations. Let, for the first operation, 
the system be a commutative group. The minimum that we require of the 
second operation, in order to get a meaningful system with two operations, 
is the associativity F5 and the distributivity F9. 

So whenever- there are two operations, say '+' and *•’, on a set X, and 
FI to F4, and F5 and F9 are satisfied, we call such a system a ring. 

We shall not give a formal treatment of rings in this book. It sufiSces 
to note that 

(i) A set X with two operations *+’ and such that (a) it is a 
commutative group for *+* and (b) F5 and F9 are satisfied is called a 
ring. 

(ii) A ring in which F6 bolds is called a ring with identity (unity). 

(iii) A ring in which F8 holds is called a commutative ring. 

For example, C, R, .Q, and Z are rings under the usual operations of 
addition and multiplication. All these are commutative rings and have 
unity. The set E of even integers is a commutative ring under the opera- 
tions of addition and multiplication. But it has no unity. ' 

Watch for further examples of rings as we go along. 

Problem Set 1.6 

1. In each of die Problems 1, 5, and 6 (Problem Set 1.5) prove that 
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the set under consideration, along with the operations of addition 
and multiplication defined therein, is a field. 

2. Let G be an abelian group with addition *+* as the binary operation. 
Prove the following identities in G : 

(a) — (— o — + b (b)o — 

(c) — (« — b) ^ b — a * (6) {c — b\ — (fl — b) c — a, 

3. Let be a ring with '+’ and *•’ as binary operations. Prove that, 
for a, b, c,d & A. 

(a) (-a) • (— h) = o • b 

(b) {a + b)'ie + d)==a‘C + b- d + a- d+ b‘C. 

4. Prove that a ring contains at most one unity. 

5. Prove that a • 0 0 for all a in a ring A. 

6. Give three reasons why N is not a field under the usual addition and 
multiplication. 
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The standard operations on functions, which yield new functions from 
the given ones, are (i) composition, (ii) addition, (iii) scalar multiplication, 
and (iv) multiplication. 

Before we begin a study of these operations, we have to make precise 
what we mean when we say ’two functions are equal or are the same’. 

1.7.1 Definition Two functions f: A-*- B and g : >4 -> B are said to be 
equal, written/* g, = g{x) for all x E. A. 

For example, the function x I— > jc® defined on [—1, 1] and the function 
X h-* X® defined on [0, 1] are not equal, because their domains are 
different. 


1.7.2 Definition Let f:A~*B and g : B -*■ C be two functions. Define 
the function h: A-* C by 


Kx) »» gifix)) for all X E . 

Then h is called the composition ofg and / and is denoted by go/, 
which is read as ‘g composite /’. ‘ Thus, we have (g o /) (x) 
gifix)) for all X E .4. Symbolically, the composition can be 
represented as 


/ g 
-*■ B -*■ 


g^f 
A — ► 


C. 


Exmple 1.50 Let /: it be defined byxt-^x+landgiit-r-Jt 
be defined by x t-^ x*. Then go/ ia tinned, and (go/) (x) gifix)) 
■■ g(aH-l) (x + 1)*. lleace,go/:x (x 1)^ is a map from il toil. 
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Example 1.51 Let /: iJ -> J? be defined by x i— ► x + 1 and g : X*' -*■ R 
be defined by x (— > ^x. Here R* is the set of all positive teal numbers. 
In this case go fit not defined, but fog is defined, since 

g f 

R*.^R^R ^ R*^ ►J?. 

and \fog){x) = f{g{x)) 

= AVx) = V* + 1 . 

Thus, fog’.x »•-»• y/x + 1 is a map from to R. 

Example 1.52 In some cases both fog and gof may be defined. In 
Example 1.50 fog is also defined and (fog){x) /(g (x)) — /(x*) 
*= X* f 1. 

Thus, in this case fog : R-*-R is defined by x t— ► x* + 1, but 
gof:R->Ris defined by x t— ► (x + 1)*. 

These exaojplcs show that when fog is defined, gof may or may not 
be defined. Even when both fog and go f are defined, they need not be 
equal. In other words, composition of functions is not commutative. 

V 

Notations The set of all functions / from to is denoted by ^{A, B). 
If h - R, the set of real numbers, then the function fxA-^R is said to 
be a real-valued function. The set of all real-valued functions on A is 
denoted by tf(AR). The notation tfiiiA) is also used to denote this set 
of real- valued functions. If R is understood from the context, the symbol 
7iA) can be used. If A is an interval, 7(A) is written also as 7lo, fr] 
or 7(0, *)• 

1.7.3 Definition Let /:/<-»• /? and g: A-*- R be two real-valued func- 
tions. Then the sum / -f g is defined as a real-valued function as 
follows : f-(- g: A-* R such that x h-^/Cx) -f- g(x). In other words, 
(/+ g) (X) =/(x) + g (x) for all x €. A. 

/ + g, as defined, is called the pointwise sum of / and g. According 
to this definition, / -t- g is also a member of 7(A). 

Example 1.53 Let f : R-* R be defined by fix) =s x® and g : R-* R 



FlOUM 1.4 
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be defined by g(x) -« * + 1. Then/ + g is the function x x* + x + 1 
for all X € /I. 

Example 1.54 Let us add the sine function and the cosine function. These 
functions are given by the graphs in Figures 1.4 and l.S. Therefore, the 



function sine + cosine is given by the rule (using Definition 1.7.3) 
(sine + cosine) (x) = sin x -F cos x . 

The graph of the function sine + cosine is as in Figure 1.6. 



1 . 7.4 Definttfoo Let A be a real number and f'. A ^ Rhea real-valued 
function. Then A/, called the scalar multiple of / by A, is defined 
as a real'valued function 

Xf : A-*- R such that x »-> A/(x) . 

In other words, (A/) (x) A/(x) for all x & A. A/ is called Xhtpointwlae 

X-muUiple of /. According to this definition, A/ is also a member of y(A). 
Example 1.55 htXf'.R-^R be given by x i— ► x*. Then A/ is the func- 
tion from Jl to H such that x t— »> Ax*. 

Rumple 1.56 The graph of the function 1/2 sine, i.e. A-multipIe of sine, 
with X»y2u given in Figure 1.7. 
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A special case of scalar midtiplication when A = — 1 gives (—1)/ as 
the function 

((-1)/) (*) — (-f) (fix)) - -/(x) for all X G /I . 

(— l)/is also denoted by — /. 

1.7.5 DefinitioB Let f:A-^ R and g: A->- R be two real-valued func- 
tions. Then/g, called the pointwise product of/ and g, is defined 
as a real-valued function 

fg'. A-*- R such that x t-^/^x) g(x) . 

In other words, (/g)(x) =/(x) g(x) for all x G 

Example 1 57 Let/ :R-*-R be defined by x‘ x* and g . R-*-Rhe 
defined by x !-»> x + 1. Then the function fg: R-* R is defined by 
X t— *> X* (x + 1). 

Example 1.58 The graph of the product of sine and cosine is given 
in Figure 1.8. 



y s Sin X cos x 

BSBKm 

x^Vv/>. 

s^2TT 

/ 
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1.7.6 Remark We have constructed functions / + g. A/, and fg. Tim 
construction of / + g from / and g is nothing but an operation 
whidi, to each pair of functions/ end g of Sr(i4)» associates • ftme- 
tion / -1- g in y(i4). Thus, this operation is a binary operation on 
^(A). It is called addition. Tlie second operation, that forming 
A/ from A and /, called scalar multiplication, is not a binary opera- 
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■ tion on tF(A). The reason is that we do not take two functions in 
^■(A) to produce a function in tF(A). However, the multiplication 
of functions / and g is a binary operation on !f(A). 

We shall refer to Definitions 1.7.3, 1.7.4, and 1.7.5 aspointwise addition, 
pointwise scalar multiplication, and pointwise multiplication of functions, 
respectively. Throughout the book, without further explanation or mea* 
tion, addition, multiplication by a scalar, or multiplication of functions is 
to be understood pointwise as already.explained. 

The following properties of addition in are easy to check. They 
should not be taken for granted. The reader should carefully check 
them. 

(i) Addition in !f(A) i$ associative. 

(ii) G2 is satisfied for addition in 3^ (A), because the zero function, 
0, acts as V of G2. 

(iii) G3 is satisfied for addition in 3^(A), because — / acts as the in* 
verse of / for addition. 

(iv) Addition in 3^(A) is commutative. 

Thus, 3^(A), for pointwise addition, is a commutative group. 

Analogously, we have, for multiplication, the following properties. 
The reader should carefully check them. 

(i) Multiplication in ^(A) is associative. 

(ii) G2 is satisfied for multiplication in ^{A), because the constant 
function C : A R such that x t-v 1 acts as the identity in 7(A). For 

we have 

(C/) (X) = C(x)f(x) = 1 fix) = f{x) for all x E A. 

Hence, by Definition 1.7.1, Cf = /for* »ll /in 7(A). 

(iii) Multiplication in 7(A) is commutative. 

(iv) Multiplication is distributive over addition in 7(A). 

But 7(A) for pointwise 'multiplication is not a group, because G3 is 
not satisfied as we shall now show. 

Suppose f:A-*Ris aftinction such that fix^) =* 0 for some x^ e A. 

In order to get a function g : ^4 -*• /{ such that fg =» C, we must have 

(fg) W =* C(x) for all jc e A 

S(*) “ C(x) *» 1 for all Jc e A. 

But at * «= this means ()g(xg> ■■ 1. No real number g(jf*) can 
satiefy thb requireinent. Therefore, no g exists with the property fg C. 
Thia mehai there are functions /in 7(A) which have no inverse for multi* 
ptktUion. 
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If ive look at all the propert/ea of additioo and maltiplication wbkb 
we have listed, we find that T'C-d) is a commutative ring with unity for 
these two operations. 

The question whether O'C-d) is a group for scalar multiplication does 
not arise, because scalar multiplication is not a binary operation. But 
scalar multiplication does satisfy certain properties, which we now list. 

, Given /, g G 3F(A), and A, /t G we have 

W ^/-hs) = V+ Ag, 

(u) (A + ^)/ = A/ + ft/, 

(iii) A(^/)- (A/^)/= ^(A/), 

(iv) A(/g) « (A/)g =/(Ag). 

(V) !/ = /. 

The reader should check these carefully. Just for guidance we check (ii), 
namely, 

+ ft)/ = A/+ (i/. 

Since this is an equality between functions, we have to prove 
((A + t*)/) W = (A/+ j*/) (*) for all x e A. 

The left-hand side = ((A + (a) /) (x) 

— (^ -h li) (/(*)) (by Definition 1. 7.4) 

== A/(*) + p f(x) (by F9 since J? is a 

field) 

= (A/) (*) -I- (!*/) (*) (by Definition 1.7.4) 

= (A/-f fr/)(jf) (by Definition 1.7.3). 

1.7.7 Remark By now it must be clear to the reader that addition, multi- 
plication, and scalar multiplication of functions are not the same 
as addition, etc., of ordinary numbers, though they may appear 
to be so. He should be careful to understand, at any stage of the 
working, whether the symbol that is being used is just a number or 
a function. 

All the results in tbi$ article are also true for i.e. the set of all 

complex valued functions on A. The only precaution we have to take 
is that \ instead of being just a real number, can be any complex number. 

We shall end this article by introducing an important concept, called 
inverse function. 

1.7.8 DeAnitioa Let/: A B be a one-one and onto .function. Then 
the inverse off, written as/'*, is thefimetion 

/■* iB-*^ A 


defined by 
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f'^(y) that unique Jt G for which y)[x) =— y . 

Note that Defiuition 1.7.8 is valid, because by Remark 1.4.9 it 
follows that, since /is one-one and onto, there is a one-one correspondence 
between A and B. 

Example 1.59 Let / : i? -*■ i? be defined by .v t—* .v -f- I . Then/"* : B 

i» given by f'^(y) =■ y'^ for all y €. R. 

If the function f : A-*- Bh not one-one or not onto, the inverse does 
not exist as a function from B. 

If the function f: A -*■ B is one-one but not onto, the in\erse does not 
exist as a function from B. But the situation can be retrie\ed by modifying 
the function/. Write/ ; A -*■ Rif) by defining /(x) - f{x) for all x ^ A. 

Essentially, / is the same as /. The only difference between /and / is 
that the target set B oi f has been restricted to Rif ) C. B without any 
damage. 

Obviously,/ is one-one and onto; so / has an inverse. This inverse 
is defined on Rif). Therefore, some authors say (legitimately!) that 
though the inverse of /does not exist as a function from B, it exists as a 
function from Rif), a subset of B. 

We shall now give two important properties. U f\ A B is one-one 
and onto, then 

(i) /o/'^ = fa and 

(ii) Ia. 

The proof of (i) is left to the reader. We shall prove (li) : 

/ : -*■ J9 is a one-one and an onto map. Therefore, /"* : B-*- A exists. 

The composition /"* o/ is a map from A to A such that 

(/-*o/)(x) - f-\fix)) (by Definition 1.7.2) 

= f'^iy) (by writing ^ =-- / (x)) 

= X (by Definition 1.7.8) 

for ail X G jf. Hence, /"* o/ = Ia. 

As mentioned in Remark 1.4.3, the symbol /'* is also used in certain 
contexts in mathematics for denoting the pre-image under /. But we shall 
not use /'* in that context. We shall use /'* only when it is the inverse 
of/. 

Problem Set 1.7 

1. Prove that the composition of functions is associative, i.e. for any 

three ftinctions h: A-* B,gx B-^ C, and / : C -> Z), we have 
(fog) oh ■» foigoh), 
fipc) — sin X, — « < X < * 
f(x) am X*, —00 < X < 00. 


2 . Let 
nd 
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Describe go/. Is /og defined? Justify your answer. Change the 
domain of g so that /o g can be defined. Then describe /o g. 

3. Repeat Problem 2 for/(x) 1 + »*, — 1 < * < If and g(*) — y/x, 
* > 0 . 

4. Prove that the set of all’ real>(comp]ex) valued continuous functions 
defined on [0, 1] is a group under pointwise addition of functions. 

5. Prove that the set of all real-valued differentiable functions on (a, b) 
is a group under pointwise addition. 

6. If / and g are defined as in Problem 2, describe / + g, /— g, and 
fg for — w < jf jr. 

7. If / and g are defined as in Problem 3, describe f + g, f — g and 
/g for 0 < X < 1. 

S. In define equality, addition, and scalar multiplication as follows : 
Equality (Xj, x,) = (y„ y^) if Xi = = y, ; 

Addition (x^, Xi) + (>’„ y*) = (x, + y^, + y,) ; 

Scalar multiplication a(xi, Xj) (ax„ ox,), where a is any real 
number, 

A function /:/?*->■ is said to be linear if it satisfies the following 
properties : 

(i) Aixu **) + (y„ >’,)) == /(;«„ Xt) + /(y„ y,) 

(ii) /{<«(x„x,)) == a/(Xi, Xj), 

for all real a. 

Prove that each function defined below is linear. 

(a) 

fb) /(x„ X,) = (xi. -X,) 

(C) /(Xj, X,) = (Xi + x„ X, - X,). 

9. Prove that for the linear function f:R* S? defined in Problem 8, 
we have 

/(Of 0) = (0, 0). 

10. Consider tfiG, H), the set of all functions from a group (7 to a non- 
abelian group Jif with a Unary operation For /, g £ ^{0, H)t 
define fg as (/g) (x) — fiix) • g(x). Ufg ^ gf’t 

1 1. True or fasle ? 

(a) The fhnction defined by /1[a -1- Ih) >■ a is an onto 

ftmctton. 

(b) The Ihnction /: C~*-R defined by /(a Ih) « h is a one- 
one functitNi. 
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(c) The function f t C-* Rx R define^ by J{a + ib) {a, b) 
is a one-one onto function. 

(d) It is possible to define multiplication of functions, which is 
noncommutative. 

We conclude this article by drawing the reader’s attention to the two 
ideas in this chapter that will form the central theme of this book. They 
are 'addition’ and 'scalar multiplication’ of functions. The study of these 
two concepts in depth and in more general situations is the study of linear 
algebra. 



Chapter 2 


Vectors 


In this chapter we shall study vectors in a plane and in space. These 
concepts originally arose in mechanics. A vector in mechanics stands for 
a line segment directed from a point P (called the initial point) to a point 

Q (called the terminal point). It is denoted by the symbol PQ, where the 
arrow indicates that it is a vector. The addition of vectors is done by the 

familiar law of parallelogram of forces. The negative of PQ is denoted 

by QP. From this the rule of subtraction follows. The study of vectors 
starting from this approach is called the geometric approach. 

The alternative approach, called the algebraic approach, is more rele* 
vant to tbe subject matter of this book. Whereas the geometric approach 
leans heavily on the fundamental geometric concepts of ’length* and ‘angle*, 
the algebraic approach uses only the properties of R, tbe set of real 
numbers. 

Today we find that the use of vectors transcends its original geometri* 
cal background of physical space and finds its application in various fields, 
including social sciences. For this reason, our study of vectors will be 
mainly algebraic. The geometric aspect will, however, be presented side 
by side, in order to supplement the understanding. In fact, keeping track 
of the geometrical perspective is very useful in that it provides a deeper 
insight into the study of linear algebra. At the end of this chapter some 
elementary applications of vectors to geometry are also presented. 

We are familiar with the cartesian coordinate system in a plane. Before 
studying vectors we shall introduce the cartesian coordinate system in 
space. 


2.1 SPACE COORDINATES 

We identify a point in a plane with the help of two tatts, called the 
x*axis and tbe y*axis. To locate a point in space, we need three mutually 
perpendicular lines X'OX, YVY^ and ZVZ through a point O (Figure 2.1). 
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This point O is^catled the origin and the lines are called x^axis, ^*axis, and 
z>axis, respectively. These three mutually perpendicular lines, called the 



Figure 2.1 


coordinate axes, determine three mutually perpendicular coordinate planes 
XOY, YOZ, and ZOX, called the Ar>'-plane. the yr^plane, and the xz-plane, 
respectively. These three planes divide space into eight parts, called 
octants. Note that 

x-axis is the intersection of the x^'-plane and the zx-plane; 
j'-axis is the intersection of the .v^-plane and the >'r-plane; and 
z-axis is the intersection of the ^z-plane and the zx-plane. 

We choose the positive directions OX, OY, and OZ of these axes in 
sudi a way that, if a right*banded screw placed at O is rotated from OX 
to OY through 90”, it moves in the direction of OZ. The axes so chosen 
are said to form a right-handed system. Figure 2.2 shows a right-handed 
qrstem and Figure 2.3 shows a left-handed system. 

Let F be a point in space (sde Figure 2.1). Then the distance of F from 
the x>-plane is called the z-coordinate of point F. Let Q be the foot of 
the perpendicular from F on the x;y-plane. Then the distance of Q from 
the ^*axis is called the x-coordinate of point F and that from tiie x-axis 
the j^*coordinate of point F. Obviduily, the X'coordinate of point F is its 
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distance from the j'z-plane and the ^‘coordinate is its distance from the 
rx'piane. 



Figure 2.4 
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is customary to say that the coordinates of P relative to the origin O are 
(x, y, 2). Thus, corresponding to each point in space, there exists a unique 
ordered triple of real numbers which gives the distance o( P(x, y, z) from 
the three coordinate planes. Similarly, corresponding to each ordered 
triple of real numbers, there exists a unique point in space, which is situated 
at a distance of x units from the yx-plane, y units from the rx-plane, and r 
units from the xy-plane. Obviously, the coordinates of the origin are 
(0,0,0). 

Distance between the points Pifx,, z^) and yn, 2t) 

To find the distance between the points P^ and P^, draw P^Q perpendi* 
culat from P^ to the plane P^RQ parallel to the xy>plane and passing 
through /*i, as shown in Figure 2.4. Further, draw QR and PiR parallel 
to the x-axis and y-axis, respectively. Then 

= s/TpMTJpM 
= V am* + (A/i)* + iPtQY 

= V (Xi-Xi)* + . (1) 

Example 2.1 The distance between the points P{1, —1,3) and C(2, 1, —7) 
is VT=WT(2TTTT? = vw 

Problem Set 2.1 

1. Locate the points : 

(a) (1,1,1) '(b) (1, 1,2) (c) (-1,3, -2) 

(d) (-1, -2,-3). 

2. Describe the loci : 

(a) y = constant (b) z » constant 

(c) X = 1, y — 2z (d) y s= —5, z* <— 4x 

(e) yV = 1, X - 2 (f) x < 0 

(g) Jc > J' (h) y > 2z, X 3. 

3. Find the length of the segment AB, wit^ end points : 

(a) A(0, 0, 0), B(l, 1, 1) 

(b) All 2, -1), £(0, -1, 1) 

(c) A(3.2,-1),B(3,1,2) 

(d) ^(-1, 3, -2), J(l, 2, 0). 

4. Look at the rectangular parallelepiped in Figure 2.5. If its length 
AB — 3.5 units, breadth BC 2 units, and height BD » 1.5 unit*, 
and the coordinates of A are (1, 2, 3), find the coordinates of all its 
vertices and the length of its diagonals. 
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2.2 VECTORS— ADDITION AND SCALAR 
MULTIPLICATION 

We start with the geometrical concept of a vector. A vector is a direct- 
ed line segment PQ with an initial point P and a terminal point Q. In 
Figure 2.6 PQ and RS are two vectors. The length or magnitude of vector 



PQ is the distance between P and Q and is denoted by | | . A vector 

of unit length is called a unit eector. 

Two vectors ^ and are said to be parallel if the line segments 
OP and O 'P' are parallel. Two parallel vectors may have the same or 
opposite directions. In geometry two parallel vectors are considered to 
be equivalent if they have the same length and the same direction, bi 

Figure 2.7 €$% O^, and ^ are parallel vectors, and OP and ^are 
equivalent vectors. However, in mechanics the need may arise to consider 
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Figure 2.7 


them a$ different. For example, OP and PS may represent two forces 
acting at two different points O and J?. In our study of vectors we shall 
ignore this distinction between initial points. We shall assume that there 

is always a coordinate system with an origin O. Given any vector AB, 
unless otherwise stated, we shall always think of a parallel vector OP 
with an initial point O and a terminal point P such that OP and AB have 
the same directions and \ OP \ ^ \ AB \ y in Figure 2.8. 



Note that, given AB, we arrive at only one OP in this way. Thus, all 
our vectors shall start from a fixed point, namely, the origin, in the chosen 
coordinate system. Such vectors arc also called /ree vectors. 



FlOURB IS 



7.2 vecrOM-^ADDlTION AND SCALAR MULTIPLICATION / 39 


Consider the vector OP in a plane, where P is the point with coordi* 
nates (aj, 0,) relative to the chosen coordinate system referred to 0 as 
origin (Figure 2.9). 


The sum of two vectors OP and OQ is given by OP, the diagonal of 
the parallelogram whose adjacent sides are OP and OQ (Figure 2.10). If 
P and Q have coordinates (tf,, a^) and (hj, b^), respectively, then elementary 
geometry tells us that the coordinates of P are (a, -f bi, + h,). (Why ?) 
Suppressing the directed line segments and writing only the coordinates 
of the vertices, we have Figure 2.10 (b) . 



Figure 2.10 


Geometrically, WP, with A > 0. is defined as the vector whose length 
is A-times the length of OP, i.e. A| OP 1 , and whose direction is the same 
as that of OP. If A < 0, then \OP denotes a vector of length — A ] OF j in 

a direction opposite to that of OA As before we get the pairs of diagrams 
as shown in Figures 2.1 1 (a) and (b), and 2.1-2 (a) and (bi. (In these dia> 
grams ] A 1 > 1 .) 

An analogous situation arises in space, where the point P has the 
coordinates (oi, Oj, 03). 



FigurbS.!! 
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Figure 2.12 


If we carefully analyse the transition from (a) to (b) in Figures 2.10, 
2.11, and 2. 12, we observe that the coordinates anda 2 >n the plane (and 
the coordinates Oi, Oj, and Oj in space) of the point P perhaps contain every* 

thing that we want of the vector OP. It is this observation that leads to 
the following algebraic definition of a vector and to the succeeding defini- 
tions in this chapter. 

2.2.1 Definition (a) A plane vector is an ordered pair (aj, of real 
numbers. 

(b) A space vector is an ordered triple (oi, o*, a^ of real numbers. 

We shall not make any distinction between the plane vector (a^, Oj) and 

the directed line segment OP, where O is the origin and P is the point 
whose cartesian coordinates are (a|, a,). In fact, we shall very often 
write 

“.=* («!.«*) = 

In this case the vector (Oi, a,) is also called the position vector of P. The 
vector (0, 0) is called the zero vector in a plane. Similarly, in the case of 

space vectors, we write v «>> t.Oi> Ot* <h) =* ^be vector (0, 0, 0) is 
called the zero vector in space. 

The length or magnitude of the vector a -> (ci, a^) » OP is the length 
of the segment OP. It is V(<>* + 0|)< In (he case of the space vector 

a («!, Of, < 7 ,) » OP, we have | a | » Vfn* + «S + «•). 

Example 2.2 The length of the vector (3, 4) is y/{.9 + 16} — S. 

Bxanvte 2.3 The length of the vector (1, 3,— 1) is V(I + 9 1) VH* 

Exangtle 2.4 The vector (V2/10, — 7V^10) is a unit vector, since its 
length is 1. 

Example 2.5 The vector (1/V3* 1/V3» i* n unit vector, since 

its length is 1. 
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2.2.2 Deflsttloa (a) The set of all plane vectors (i.e. the set of all ordered 
pairs of real numbers) is denoted by fg- 

(b) The set of all space vectors (i.e. the set of all ordered triples of 
real numbers) is denoted by Kg. 

Note that K, is the cartesian product R y. R. For this reason Kg may 
also be denoted by /?*. Similarly, Vg^^RxRxR’^J^. 

2.2.3 Definition {Equality) (a) Two plane vectors (oi, a,) and {bg, 
are said to be equal if Oi ~ bi and Og « i.e. (Oi, Og) » \bi, b^ 
if Oi ^ bui = 1, 2. 

(b) Two space vectors (oi, Og, Og) and (b„ bg, bg) are said to be 
equal if o, = hi, c, = bg, and Og — bg, i.e. (Oi, Og, Og) = {bg, bg, b^ 
if a, = bi, i = 1, 2, 3. 

The direction of a nonzero vector in K, is the radian measure 0, 
0 < 6'<2rr, of the angle from the positive direction of the x-axis to 

the vector OP measured counter-clockwise. If « = (cj, Og) *= OP, then 
the direction 0 of h (s given by 


sin 0 ■- 



cos 6 = 


fli 

Va,* + Og* 


In Kg the direction of a vector is given by its direction cosines, which 
we shall study in § 2.4. Note that the direction of the zero vector is 
undetermined. 

Example 2,6 The direction 0 of the vector (l/\/2, l/VZ) is given by 
sin 0 — 1/V2 *“ cos 0. So 0 =* ic/4. 


Example 2.7 The direction of the vector (3, 4) is given by sin 0 » 4/5, 
cos 0 = 3/5. 


Now we shall define the addition of two vectors in a plane as well as 
in space. These definitions correspond to the geometrical definition of 
addition. 


2.2.4 Definition {Addition) (a) Addition of vectors in Kg is defined as 
(Ou ®t) + + bi, Og + bg) 

for all vectors (Og, <^), (bg, b,) in K,. 

(b) Addition of vectors in K, is defined as 

(Og, Og, 0g) + (bg, bg, bg) 5= (Og -i- bg, Og -f- bg, Og -F bg) , 

for all vectors ( 4 g, Og, Og), (bg, bg, bg) in K,. 

Example 2.8 The sum of the vectors (3, —1) and (—1, 4) is the vector 
(3, -1) + (-1. 4) « (2, 3). 

Exan^le 2.9 The sum of the vectors (—1,0,7) and (3,2, 1) is the 
vector (— I, 0, 7) 4* (3, 2, 1) «=» (2, 2, 8). 
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Obviously, these operations of addition ere binary operations in 
and Vt, respectively. We shall now prove that f', and Vg are conuttutative 
groups for these operations. 

2.2.5 Theorem the set of all plane (space) vectors, under the ope- 

ration of addition, as in Definition 2.2.4, is a commutative group. 

Proof : The proof for is left to the reader. To prove that K, is 
a commutative group, we check the following : 

01 Vector addition is associative 

Let u =s (fli, fl,), V * (bj, bj), and w •» (c,, Cj) be three vectors in 
F,. Then 

(If + ») + B» ((flj + bi) + Cl, (a* + bg) + Cj) 

and •» + (v + w) = (Oi + (b, + cj, a, + (bg + o)) . 

But we know that for real numbers at, bf, and Ct (cf § 1.6) 

(a, + bi) + r. *= a, 4- (b, + c,), / = 1, 2 . 

Therefore, (a -|- ») -f- w = a + {v -h w) for all a, r, w G f',. 

02 Existence of identity 

For any a = (a„ a,) in Kg, we have 

(0. 0) + (Oi, ag) = (a„ ag) -= (oi, Og) + (0, 0) . 

So the zero vector (0, 0) plays the role of identity. The zero vector 
usually denoted by 0. 

03 Existence of inverse 

Oiven a vector u = (ai, ag), the vector x {—Oi, — «*) satisfies 
x4-b = 0 = b + x. 

This vector x is called the additive inverse of u or the negative of b and 
is denoted by — b. 

G4 Vector addition is commutative 

Let B SB (Og, a,) and v xs (b,, b,) be two vectors in K,. Then 
B + r = (Og + bg, a, + b,) 
and V + B — (b, + a„ b, + «») . 

But we know that for real numbers ag, a„ bg, bg (cf § 1.6) 
a< + b| — bf -h Of, f ** 1,2- 
Therefore, • + » <“ v + b for all b, v G K,. 

This completes the proof that K„ under the operation •+’, is a 
commutative group. | 

It may be noted that the additive identity of the group Kg is the vector 
(0, 0, 0). We shall use the same qrmbol 0 for this vector also. In K, if 
B *- («!. a,, a,), then — b •• — a„ a,) •• (-0|,— a„ — Oi). 

IM Ddbrirton (Scalar natlt^HcMfon) Muhii^icBtion of vectors in K, by 
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a real oumber is defined as 

flj) * (Afli, Ao,) 

for every (a„ E and every real number A. Similarly, in 
A (fli, a*, at) =-. (Xoi, A Aa^) 
for every (a^, a,, a,) E K, and every real number A. 

Example 2.10 If the vector » =» (3, — 1), then the vector 2« •» (6, —2) 
and in = (1. -1/3). 

Note that scalar multiplication is not a binary operation. (Why ?) 
However, it does satisfy certain natural properties which we shall list and 
prove. 

2.2.7 Properties of Scalar Multiplication 

For all vectors u. v in Kj f or in V^) and real numbers a, p, we have 

(a) a(n + v) ^ «n + “r. 

(b) (a -i- P n = an + Pn. 

(c) a(pal = (apill = P(all). 

(d) In - «. 

(el On = 0. 

Proof : We shall prove (a) as an illustration of the method of proving 
these properties. Further, we shall prote this in only. The rest are 
left to the reader. 

Let n = (ffi, flg, at) and v -- (bj, b^, bi) be two vectors in Vt, and a 
be a real number. Then 

u + r =. (o, + bi, fl* -f bt, at + bt) 
and o(» V v) - (o(aj + h,). oCOg i- bt), a{aa + bt)) 

= (owii + abt, aflj + ah^, an, + ah,) (1) 

by properties of real numbers (cf § 1.6). Further, we have 
aa + af =-! a(tfi, a,, 0,) + a(ht, h,. h,) 

»=S (ofl,, aOt, ad,) + («ehi, oh,, ah,) 

= (ofli + «h„ ao, + ah„ oa, + «h,) 

«(• + t) (by (1)). I 

The last two properties, namely, (d) and (e), may look trivial to the 
reader. In fact, ^ey just say ^ 

tit, a») * {!«». i®*) (Definition 2.2.6) 

“(fli.flufls) 
and 

«* (Qat.0a«0s^ (Definition I2.d> 

• (0.0^0). 
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Let the teader reserve his opinion until be comes to the discussion of 
an abstract vector space in Chapter 3. Then he will see the significance 
of properties (d) and (e) and also the delicate difference between them. 

2.2.8 Definition The difference of two vectors m and v, written as « — s, is 
defined by « — v “• « + (— s). 

Example 2.11 Let » *= (3, 4), r « (— 1, 3). Then «-!' = «+ (— v) 
- (3, 4) + (1. -3) « (4. 1). ^ 

We shall now find the vector « — v geometrically. Let n = OP 
*• (flif <*») and K s=s Og =s b^. The negative of v, i.e. — r, is 
(— 6i, — fi,). Geometrically, it is the vector QO which is the same as 
OQ' (see Figure 2.13), where Q’ is the point whose cartesian coordinates 



—b^. The vector a — r is the diagonal of the parallelogram 

formed by a and f. It is the vector gR = ^ « (Ji - bu a, - 6,). 
Analogously, we can find a — v in F,. 

For every nonzero vector a, the vector | a is a unit vector in the 

direction of a. If a « (oi, a,) ^ 0, the unit vector in the direction of a is 


/ «*a \ . 

' Voi* + flf* ’ Voi* + Os* ' 

If a (oi, Og, a,) 0, the unit vector in the direction of a is 

flt* + fli* + o/ ’ Voj* 4- 0 ,* -f a,® ’ V fli* + «** + Oa* ^ 

Example 2.12 If a » (3, 4), the unit vector in the direaion of a ie 
( 3 / 5 . 4 / 5 ). 

Bxanvle 2.13 If a - (1, 1, 1). the uidt vector in the direction of a is 
(1/V3. 1/V3. 1/V3). 


Ot 
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In a plane the unit vector in the direction of an angle 6 is (cos 6, sin 0), 
as shown in Figure 2.14. It is also called the unit vector at an angle 0 with 



Figure 2.14 


the positive direction of the x-axi$. The unit vectors in the positive 
directions of the x>axis and the y-axh are (1, 0) and (0, 1), respectively. 
They are denoted by i and/, respectively, i.e i = (1, 0) and J — > (0, 1), 
as in Figure 2 15. 



Figure 2.15 

In space the unit vectors along the positive directions of the x-axis, 
the y-axis, and the i-axis are respectively (1, 0, 0), (0. I. 0), and (0, 0, 1). 
They are denoted i* J, and k, respectively, i.e. i «> (l, d, 0), 
J » (0, 1, 0), and k « (0, 0, 1). Though we use the same letters i and 
/here as in the case of plane vectors, there cannot be any confusion, 
because the context will always show whether we are talking of plane 
vectors or ^ace vectors. The importance of unit vectors is brought out 
by the following theorem. 
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2.2.9 Theoreai (a) Every plane vector is of the form af + aj and every 
vector of this form is a plane vector, 

(b) Every space vector is of the form aj + OiJ + a^ and every vector 
of this form is a space vector. 

Proof t We shall prove (b). The proof of (a) is analogous. Let 
(ax. Of, at) be a vector in K,. Then 

(Ox, Ot, a,) = (ax, 0. 0) + (0, a,, 0) + (0, 0, a,) 

= ai(l, 0. 0) + 0,(0, 1, 0) + 0,(0, 0, 1) 

= Oil + aj + ath. 

Thus, every vector in F, is of the form a^l + OfJ + Oth. On the other 
hand, a vector of the form a,i + a,^ + adt is the sum of vectors 0 |f, 
aj, and Otk of F,. Since vector addition is an associative binary opera- 
tion, a,j + aj 4- a,it is a vector in F,, i.e. a space vector. | 

Geometrically, Theorem 2.2.9 means that every vector can be represent- 
ed as a sum of scalar multiples of unit vectors along the coordinate axes, 
as shown in Figure 2.16. 




Figure 2.16 

The numbers a,, a, are called the components of the plane vector 
u (a,, <^) s: Oxi + a,/ a, is called the i^iomponent (or x-oomponent) 
and a, is called the ^-component (or ^'-component). We also say that 
Ox and 0 , ate the coordinates of • with respect to i and j. 

Similarly, ax, Ot, and a, are called the components of the space vector 
• » Gt> <>s) >= Oif + aj+ Ox is the Acomponent. a, is the 
/component, and a, the ^-component. We glso say that Ot, Ot, and a, are 
coordinates of u with respect to and k. • 

Pfobhm Set 2.2 

i. Find the magnitude and direction of the ftdlowing plane vectors : 

(•) (2,3) (b) (3,-1) (c) (3,6) (d) (-1,2) 

(fi) l + J (f) 21-5/ (D -14-4/ (h) -41-5/. 
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2. Find the magnitude of the following space ve^on ^ 

(a) (2, - 1, 3) (b) (3, 0. 4) 

(c) 3i + 2J-k (d) -i-2J + 4k. 

3. Simplify 

(a) 3(2, - 3) (b) 4(1, - 1, 3) 

(c) 2(1, - 1) - 7(5, 1) (d) 3(2, - 1, 4) + 4( - 1, 5, 0) 

(e) 7(3/ + 2i - *) - 4(2/ - i + k). 

4. Express the following vectors in terms of the unit vectors /, ), and k ; 

(a) (2.3) (b) (-1,4) (c) (-3,-5) 

(d) (5,3. -2) (e) (2,0,1) (0 (-1,2.0). 

5. Express the following space vectors as sums of scalar multiples of 
a = (1. 1, 1), v = (1. 2, 3), and w = (2. 3. 5) : 

(a) (1,3,5) (b) (7. -1,3) (c) (2, -2. 1) 

(d) i+j-k (e) -2i+J-Sk (f) 3/ - 7/ - 2*. 

(Hint : Assume each vector to be equal to (a « + 9 v + t w), where 
a, and y are real numbers.) 

6. Find a unit vector u in the direction of each of the vectors in 
Problems 1 and 2. 

7. Find the tmit plane vector in the direction : 

(a) e = ~3«/4 (b) 6 - ic/6 (c) 6 = 7«/4. 

8. Given a point A, determine a point B such that the vector AB is 
equal to the vector v in the following : 

(a) V « (1, -2, 3), A (0, 1, -1) 

(b) V = (3. 1,-2), ^(-1,2.3) 

(c) F = (3, -7, 1), A (1, 5, 0) 

(d) F - (1, -1, 1). A (2. 3, 5) 

(e) F « (1, -2), A (1, -2) 

(0 » - (-1.5), AO. -3). 

9. Given the midpoint of AB, determine the points A and B such that 
the vector AB is equal to the vector f in the following : 

(a) F (1, 3), midpoint of ilifis (1* 2) 

(b) F a (— 1, 2), midpoint of /AB is (0, 0) 

(c) F »= (3, —1, 2), midpoint of AB is (3, —1, 2) 

(d) F «■ (—2, 0, 1), midpoint ct ABhil, 3, —2). 

. to. Prove that together with the operation of vector addition is a 
oommutatiive group. 
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11. Let 0 a= OA and r •a OB ht two vectors. Then prove that 
u — V BA. 

12. Prove the properties of scalar multiplication (b) and (c) stated 
in § 2.2.7. 

13. Prove that an *= 0 (If* = 0 or a = 0. 

14. Let 0 be a nonzero vector in Kg. Then prove that the set 
S =3 {a 0 I a £ i?} is a group under vector addition. 

15. Let 0 and v be two nonzero vectors in Kg. Then prove that the set 
S = {av 1 a, ^ £ /?} is a group under vector addition. 

16. True or false ? 

(a) ^(2.0.4) = (1,0,4). 

(b) (a + b, b + c, c + a) + (c,a,b) = {a b + c) (1, 1, 1). 

(c) 2/ + 3/ =* y + 2i. 

(d) I* + ^ + ifc is a unit vector. 

(e) 0 - (a, b) = (-a, b). 

(f ) OP-6q = PQ. 

(g) If 0 and V are vectors, then 0 v has not been defined so far. 

(h) ab =3 0. 

(i) On = 0. 

(j) The zeros on both sides of (e) in § 2.2.7 are different. 

(k) Let ABC be a triangle. Then AB + BC + CA =0. 

2.3 DOT PRODUCT OF VECTORS 


We start this article with the definition of the angle between two 
vectors. 

— > ► 

2.3.1 Definition Let 0 = OP and v = OQ be two nonzero vectors. 
Then the angle between a and v, a ^ A r, is defined as the angle 

of positive measure 0 between OP and OQ interior to the triangle 
POQ (Figure 2.17). If a = Av, then the angle 6 is defined as 6 as o, 
if A > 0, and 6 = w, if A < 0. 

It follows from Definition 2.3.1 that 0 < 0 < n. We shall now prove 
the following theorem, which gives the angle between two vectors. 

3.3.2 Thcorott Let u (ai, Og, Og) » OP and r as hg, b^ OQ 

be two nonzero vectors in Kg. Let 6 be the angle between m and v. 
Then 

I DP 1 I Dg I cos 6 — oih, + flghg + ogh, . (1) 

Proof : If 0 6 < It, consider the triangle POQ (see Figure 2.17). 
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Figure 2.17 


We have QP — OP — OQ. From geometry, wc have 

1 OPl* -h 1 O0 I* - 2 I OF| 10eicose= 1^1* 
or 210P1 lOeicose = 1^1*+ lOel*- 1^1* 

I (**i ~ ®s ^a» ^3) I * 

= {a^ + fla* + «3*) + (*i® + V + 

~(®i ^i)' (®2 ^a)' (®8 “ ^ 3 ) 

= Tajbi + 2aJ>2 + 2a2bg, 

Therefore, | OP 1 1 OQ 1 cos 0 — «i6i + o^b^ + a^bg. 

Now let 6 = 0 or 0 = 7t. In these cases we have OP = 
where p > 0, if 0 = 0, and 0 < 0, if 0 = n, i.e. p = [ p | cos 0. Thus, 

(flj, flg, flj) — bj, b^, i.e. Oi ~ pftf, i ~ 1, 2, j. 

Hence 1 OP 1 1 ^ I cos 0 = | p | | Og | * cos 0 

= 1 p l(cos0)(V + V + V) 

= PCV + *a* + V) 

= fll&jl + Oj&a + ®3^3 > 

because a< =* p&<, / = I, 2, 3. 

A similar result can be obtained for plane vectors. We have only to 
suppress the third coordinates Os and b^. In this case, if * = (a^, ^a) = OP 
and f « (^ 1 , bf) = OQ, we have 

1 OP 1 1 Ofi 1 cos 0 « 0,^1 + c,i, , (2) 

where 6 is the angle between the vectors « and ?. 
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Example 2.14 Let m *= (3, 2) and v = (2, 5). Then the angle 6 between 
the vectors a and v is given by 


So 


1 (3. 2) I 1 (2, 5) 1 cos e 
16 


cos 0 = 


v'13 V29 


= 6 + 10 . 
1 ^ 
V377 ' 


Example 2.15 Let « = (1, -1, 3) and r = (3, 1, 1). Then the angle 
8 between the vectors u and r is given by | (1, — 1, 3) | | (3, 1, 1) | 
cos 6 = 3 — 1 + 3. So cos 0 = 5/11. 


Now we shall define the dot product of two vectors. Actually, there 
are two different ways of multiplying two vectors. In one the product is 
a real number, whereas in the other the product is a vector. In this article 
we shall consider the first kind of product. The second kind will be dealt 
with in Chapter 6. 


2.3.3 Definition Let u » OP and v — OQ be two nonzero vectors and 
8 be the angle between them. Then the dot product (also called scalar 
product or inner product), written as a • v, is the real number defined 
by 


« • V = I OP I I OQ I cos 6 = I H I I v I cos 8 
If either « or v is the zero vector, then u • v =0. 


(3) 


This definition is based on the geometric concept of the angle between 
two vectors. However, Theorem 2.3.2 gives an algebraic expression for 
the dot product of « and v in terms of their components. Hence, Definition 

2.3.3 may be equivalently written as follows. 


2.3.4 Definition Let u »= (Oj, Og) and v = (6„ h,) be two vectors of V^. 
Then the dot product » • v is defined by 

« • V = . (4) 

If « == («!, a,) and v — (6,, b,, 6,) are vectors of F,, then u • f 

is defined by * 

« • F = a^bi + Ujb, + a^3 . (5) 

Note that the formation of the dot product is not a binary operation. 
(Why ?) However, it satisfies the following properties. 


2.3.5 Properties of the Dot Product 


Let 1 

1, F, w be vectors in Fj (or in V^) and 

a, p be real numbers. Then 

(a) 

m • H I M 1 hence u * 

■ > 0. 

(6) 

(b) 

a ‘ H ^ Oiffn = 0. 


(7) 

(c) 

« . F => F • «. 


(8) 

(d) 

w . (f 4- w) » » . F + 

• w. 

W 

(e) 

(cut) . F - « (» • f) - • . 

(w). 

(10) 
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Proof : We shall prove these properties for vectors in Fj. Analogously, 
by suppressing the third coordinate, we can prove these properties for 
vectors in F,. Let « *= (oi, a„ a,), v = b^, w «= (cj, Cg, c,), and « 

be a real number. 

(a) u • u c,* + fl,* + a," = 1 « I *. 

(b) If « = (0, 0, 0), then » • h — 0. Conversely, if * • « = Oi* 

+ ff,* + « 3 * = 0, then a, = flj = flg = 0, because oi*, a,*, 
and are all nonnegative. Hence, u ~ (0, 0, 0) 0. 

(c) j» • r =1 + AjAj = bfii + Vs + = >' • ■ * 

(d) « • (r + a>) = fli(Ai + Cg) + afb^ + r*) + OaC^a + <‘s) 

= + ajftg + 0363) + (OiC, + aac* 4 - flag’s) 

= H • V + B • W. 

(e) (oil) • r = (aat)*i + (*fls )*2 + («‘'3)*a 

= *(Vi) + a(fl4bj) + (*.{ajl}^ 

= a(fli6, + fla^a + Vs) = «(« ’ >’)• 

Similarly, u • (av) = a(H • r). | 

Another important property satisfied by the dot product is the follow- 
ing. 


2 . 3.6 Schwarz Inequality 

For any two vectors u and v of Fj (or VJ^, we have 

l«-rl<l«l iPl, 

i.e. 

(« • v)* < (h • «)(v • v) . (11) 

Proof : If either « or ? is the zero vector, there is nothing to prove. 
So we assume that u and v are nonzero vectors. Let 6 be the angle 
between « and v. Then, by Definition 2.3.3, vte have 


cos 6 

But I cos 6 ! < 1. Therefore, 

1 « • f 1 < I » I 



i.c. (■ • r)* < I B I * 1 r 1 * = (8 • u) (F • r). | 


Example 2,16 The dot product of the vectors (2, 1) and (—1, 6) is 
(2, 1) • (-1, 6) = -2 + 6 = 4. 

Example 2.17 The dot product of the vectors (1,-1, 3) and (0, 1, —3) 
isO + (-1) + (-9) « -10. 


Example 2.18 For any real numbers Oj, a,, a,, bi, b^, and vte have 

(Vi + Vs + Vs)* < (V + V + V) CV + V + V)* 

(Hint : Apply Schwarz inequality to the vectors n 

f ■■ (V W<) 
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Applying the definition of dot product to the vectors /, j, and A, we 
have 

(by 2.3.5 (0) 

and i • j j ‘ k = k ‘ i = 0 . 

We know that 0 • » » 0 = « • 0 for any vector «. The converse is 
not true, i.e. » • v -= 0 need not imply that either of the vectors « or v is a 
zero vector. For, / • y = 0 but i and j are both nonzero vectors. 

. In general, if u and v are nonzero vectors and if a • r = 0, then in view 
of Definition 2.3.3, cos 6=0, where 6 is the angle between u and v. In 
other words, u and v are perpendicular to each other. Thus, a • v = 0 
implies that either a = 0ori' = 0ora and v are perpendicular to each 
other. 

2.3.7 Definition Two vectors a and v of (or K,) are said to be ortkogo- 
na/ if a • V = 0. 

Note that 0 is orthogonal to every vector a and i, j, k are pairwise 
orthogonal. 

Example 2.19 Let a = (1, 2, 3) and v «= (2, — 7, 4). Then a • f = 2 — 
14 + 12 =- 0. So a and v are orthogonal. 

Example 2.20 Let a = (1, 2, 3) and f = (2, — 5, 4). Then u • v = 2 
— 10 + 12 7^ 0. So a and f are not orthogonal. 

Every vector a = (oi, a«) in a plane can be expressed as the sum of 
two orthogonal vectors oii and aj. and aj are called the resolved 
parts of a respectively along and perpendicular to the x-axis. In general, let 
a and f be two vectors. If we express a as a sum of two vectors Wj and n>t 
such that wi is parallel to f, and wt is orthogonal to f, then if, and Wj are 
called the resolved parts of a respectively along and perpendicular to f. 
In such a case, we have 

a = IF, + IF* , 

where w, => Af for some real number A and if* • f °= 0. 

Hence, 

« . F = (if, + IF,) • F = IFi • F + W, ■ F 
= (Af) . f = A(f • f) . 

Thus, 

A ■■ if F • F ^ 0 . 

F • F 

Therefore, 

Wi “ r and w, -» a — if* *■ a — f (Figure 2.18). 
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P 



We bave thus proved the following theorem. 

2.3.8 Theorem Let vbea given nonzero»vector. Then any nonzero vector 
m can be expressed as the sum of a vector parallel to v and a vector 
orthogonal to v. 


In the foregoing discussion the vector m — " — • v is called the vector 

V * V 

projection of « along r. 

The scalar projection of u on v is I w | cos 6, where 6 is the angle 

U ' F 

between u and r. Obviously, the scalar projection of o on f is and 

the vector projection of a along v is 


w • V _ u ♦ V V 
F • F ^ “ 1 F 1 1 F I 

(scalar projection of « on f) times the unit vector 
in the direction of f. 

Thus, the magnitude of the vector projection of m along v is the absolute 
value of the scalar projection of a on v and the direction is the same as 
that of F, if 0 < Jt/2, and opposite to that of f, if 0 > itjl. If 0 «=* je/2, 
the vector projection of « along f is 0. 

Example 2.21 Let « = (1, 2, 3) *= i+ 2/ + 3* and v = (—2, 3, 0) 
=» -2/ + 3y + 0*. Then 

n • 1^ 2 -4* 6 4 

scalar projection of w on f is — r — / — = ■ ■ /- 

I P I V 13 V 13 


V * V 4 

vector projection of u along f is ’'** 13' 

8 . . 12 . 

“ “ TT * IT-' ■ 

Also 

• -(1.2,3) = (+y+» - {- i+ -|5-./ + 0») 
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This is the resolution of u along and perpendicular to f. The reader 
can check that (— -^i + y + 0* ) is along ? and (“jy f + 

14 

-jj ^ + 3* ) is perpendicular to f. 

Problem Set 2.3 

Work out Problems 1 through 4 for each pair of vectors » and f given 

as follows. 

(a) M = (1.1). » « (-1,3) 

(b) a = (-2, 5). » « (1, -6) 

(c) a = I + y. * = 2i - 3i 

(d) a = -3r + SJ, v ^ 6i + Aj 

(e) a =* (1, 3, 5), v = (-3, 1, 1) 

(f) a - (2, -1. 4). V = (1, 2, -1) 

(g) a = -i+; + *. » = 3i~2J + k 

(h) a = 2i-3j + k, t^i+J + k. 

1 Find a • v. 

2. Find the cosine of the radian measure of the angle between a and v, 

3. Find the scalar projection of a on r. 

4. Find the vector projection of v along a. 

5. Find the real number a such that the vectors a and v given as follow 
are orthogonal. 

(a) a = (2.a.l), V =. t4.-2. -2) 

(b) a = (1, -2, 1). V = (2. 1. «) 

(c) a =s (0, 3, —2), ¥ =s (o, 4, 6) 

(d) a = («, —3, 1), ¥ >= (a. a, 2). 

6. For any vector a, prove that 

a » (a • i)/ + (a • J)j + (a • k)k. 

7. Let a and v he two vectors of F, (or Kj). Prove that 

(a) 1 a + V 1 < 1 a I + 1 V I 

(b) I a • V I => I a I I ? I ((f a is parallel to v. 

8. Let a be orthogonal to both v and w. Then prove that a is orthogo- 
nal to each vector of the set {av + | a, ^ any real numbers}. 

9. True or false ? 

(a) a • v ss 0 implies either a » 0 or v » 0. 

(b) If a ' r a 0 for all v € then a >■ 0. 

(c) a • (v • w) is meaningless. 
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(d) (a ■ i')m is a vector parallel to 

(e) In space if a • y 0 and a • A = 0, then a — i. 

(f) n, -1) . (-1. 1,0) = 0. 

(g) 1 a 1 -o 0 (If a = 0. 

2.4 APPLICATIONS TO GEOMETRY 


The main applications that we consider in this article are equations to 
lines and planes and certain associated problems. First, we shall work out 
a few examples to illustrate the power of vector methods. 

Exanple 2.22 In trigonometry, the formula 

cos (6 — +) =■ cos 0 cos ^ + sin 0 sin ^ 
is fundamental. We shall prove this fotmula by using vectors. 

Proof : The unit vectors OQ and OP (see Figure 2.19) at angles 0 and ♦ 



with the positive direction of the x-axis are respectively 
cos 0f + sin 0y and cos + sin . 

The angle 0 — between the vectors OQ and OP is given by 

cos (0 — +) = ■ = cos 0 cos + sin 0 sin ^ . 

\OP\ \OQ[ 

Example 2.23 Prove, by using vector algebra, that the three altitudes of 
a triangle are concurrent. 


Proof : Let AD and BE be the two altitudes of a triangle ABC, meeting 
at the point O (see Figure 2.20). It is sufficient to prove that CO is 
perpendicular to AB. 

Clearly, 

AO • BC • 0 , 


and 


UO . Ci4 <= 0. 


( 1 ) 
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A 



Figure 2.20 


Note that we are working with vectors that do not have the same 
initial point. Now 

^ • Js = • (^ + O) 

= GO • AC+ CO • CB 
= +m) AC + (CA + AO) 

= C^ AC+i0-^ + C4 Cfi + i40 CB 
= c 5 ]<C + C4.^ (by(l)) 

= CB • AC -AC (because CA = -AC) 


= CB AC - CB AC = 0 (by 2.3.5 (c)). 

We shall now take up the standard applications of vectors to equations 
of lines and planes in analytic geometry. First, we note that if P (x^, 

and Q(Xt, y^) are two points in a plane, then the vector PQ is given by 


PQ = OQ — OP ^ {xt — Xi^yt — yi) = (x* — Xi)i 4- (^'a — yi)j . 
Similarly, if i»(xi, yi, z^) and g(x„ y^, z,) are two points in space, then 
the vector Pg is (x, — Xi)i + CVa — J'l)/ + (^a — ^i)*- 
2.4.t The Equation of a Straight Line 

Consider a straight line L parallel to a vector n and passing through 
a point P (Figure 2.21). 



Figure 2.21 
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Let C be a point on L. The vector r (O it the origin) ia called 
the poaition vector of point Q, Let v be the poaition vector of point P. 
Then 

r « » OP + P^ 

= V + a vector parallel to a 

- V + m , (2) 

where t is a real number. This equation ia satisfied by all points Q on the 
line and by no points off the line. (Why?) It is called tite vector equa* 
tion of a straight line through a given point P and parallel to a given 
vector a. The following special cases are worth noting. 

2.4.2 Line in a Plane 

Let P be the point (x^, and a be the vector (a, b). Then 9 => OP 

(^1* yi) nnd r = OQ » (x, y). Then the equation of the line takes 
the form 

(jt, y) *= (»1. yi) + t(«. b) == (Xi + ta, yi + tb ) . 

This equation can be written as a pair of equations : 

X = Xj + M, 7 = J'l + /*, 
i.e. (x - Xi) = ta, {y - y^i = tb. 

These are called the parametric equations of the straight line. Eliminating 
t, we get the cartesian equation 

a{y — yi) =» b{x — Xi) . ( 3 ) 

If a = 0 or h s=: 0 , vector a becomes a vector along one of the coordi- 
nate axes and the line has the equation x x^ox y ^ 7i. 

If a ^ 0 and h 9^ o> Equation ( 3 ) may be written in the symmetric 
form as 

x-Xj - y- Vi . 

a b 

If a is a unit vector at an angle 0 (9^ tc/ 2 ). then a 
sin 8). Hence, Equation ( 3 ) may be written as 

y — yi =* tan 6 (x — Xj) 
or 

y-yi^ m{pc-x^, ( 5 ) 

where m is the slope of the straight line L. Thus (S) is the equation of 
the straight line through P(x^, y^ and having slope m. 

Thus, given a vector, we have found the equation to a straight line 
parallel to the vector. The converse situation is contained in the follow- 
ing example. 


(4) 

— (0, b) (cos 8 , 
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Example 2.24 Let /jc + wj' + « — 0 be the equation of the straight 
h‘ne L in a plane. Then the vector — mi •{- Ij is parallel to L and the 
vector tt + tr^ is perpendicular to L. 

Case 1 0. 

If either / » 0 or m = 0, then the straight line L is parallel to one 
of the coordinate axes and the result is true. 

Now suppose that I 0 and m ^ 0. In this case the two points 
Pi—njl, 0) and 0(0, —ntm) lie on L. The vector QF is — —i + 

The vector ^ is parallel to the vector QP and hence to the line 
L. This vector is —mi + Ij. 

The vector li + mj is perpendicular to the vector QF and hence to the 
line L, because 

(li + mj) i) = -n + n -= 0. 

Cflje 2 n == 0. 

Shift the line lx + my = 0 parallel to itself and obtain lx + my 
+ n’ » 0, n' 0. Using Case 1, we get the desired result. 

2.4.3 Line in Space 

Let P be the point (x„ Zj) and » be the vector (a, fr, c) Then 
V ^ OP ^ (xj, y^, 2i) 

and = {X, y^ z) = (Xi, yi, Zi) + r(a, b, c) . 

r a (x, j IS the position vector of any point Q on the line L. This 
vector equation may be written in the parametric form 

X = Xi 4 to; y yi + tb; z = + tc. (6) 

Eliminating t, we get the symmetric form 

x-Xi __ y-pi _ z-zt, 

Z 5 c 

provided a, b, and c are nonzero. Thus, we get another form of the equation 
of a straight line through P(Xi, yi, z^) and parallel to the vector 
a ^ <d + bj ck. 

If any two of the numbers a, b, c are zero, say a = h » 0, then the 
vector H (0, 0, c) becomes a vector along the z>axis. The equation of 
the straight line, from Equation (6), is 

jc - x„ y ^ Vi. 

Note that these two together represent the straight line. 


( 8 ) 
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If just one of the numbers a, b, c is zero, say a « 0, then a is the vector 
bj + ck. The equation of the straight line, from Equation (6), is 

* = (9) 

These two together represent the straight line. 

2.4.4 Direction Cosines 


Let a, p, Y be the inclinations of the vector « = OA — (a, b, c) to the 
positive directions of the coordinate axes OX, OY, OZ, respectively, as in 
Figure 2.22. Then cos a, cos cos y are called the direction cosines of 



Figure 2.22 


the vector u — at + + ck. These are also called the direction cosines 

of a line parallel to u and in the same direction as a. The ordered set 
{cos a, cos p, cos y} is called the set of direction cosines of the line re- 
presented by vector a. Clearly, 



a 

VcF+W+^ 


( 10 ) 



(H) 


cos Y == 


•y/o* + h* + C* 


It follows that cos® a -f- cos* P + cos® y = 1. For any real numfier 
k, the ordered set {k cos a, k cos k cos y} is called the set of direction 
ratios of a line parallel to a. Clearly, a, b, c are the direction ratios of the 
line parallel to the vector ai + bj + ck and hence of the line • 


x — x. 


y-ix 


z — z. 
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2.4.5 Tbe Equation of a Plane 

Consider a plane passing tlirough a point Q(Xx, yi, and peipeodi- 
cular to a vector m es OA (a, b, c) (see Figure 2.23). Let F(x, y, z) 



Figure 2.23 


be a point in the plane. Then the vector QP = (x — Xj)/ + (y — yi)j 
+ (z — z{)k lies in the plane and is perpendicular to the vector u = oi 
4- bj 4- ck. Therefore, 

« • ^ = 0 , 

which gives 

a(x - Xi) -t b(y- -i c(z — z^) = 0 . (13) 

This 15 satisfied by all points P on tbe plane and by no points ofi the 
plane. Equation ( 1 3) is called the equation of the plane through Q(xi, y^, Zi) 
and perpendicular to the vector u = (a, b, c). 

Equation (13) of the plane can further be simplified to the form 
ax + by + cz + d = 0, 

where d = —axi —by^ —cz^. Thus, the equation of a plane in space is 
a linear equation in x, y, and z. Conversely, consider a linear equation 

Ax + By Cz D 0, (14) 

where A, B, and C are not all zero. Let A 0. Then we can write 
Equation (14) as 

which IS the equation of a plane through the point (—DjA, 0, 0) and per- 
pendicular to the vector Ai + BJ +Ck. 

Two planes, if not parallel, intersect in a straight line. Thus, a straight 
line may also be considered as the intersection of two planes, and hence 
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its equation may also be given as a pair of equations of planes, e.g. 

OiX + bjy CiZ + di = 0 

and OfX + f + rf, — 0 

represent a line. From these equations, we can get the equation of the 

line in the symmetric form 

x~Xt _ y-yi ^ z- Zj 
a b c 

We illustrate this by the following example. 


Example 2.25 Find the symmetric form of the equation of the line of 
intersection of planes 


x:-|-3>'- z + 5= 0 

and 5x — 2y + 4z — 8 =» 0 . 


Eliminating z from the two equations, we get 
9x + lOy + 12 = 0 

or 9jr = - lO;' ~ 12 . 

Eliminating x from Equations (IS) and (16), we get 


or 

So, we get 


or 

or 


y - 


9z' 33 

17 17 


= 0 


-lO^* — 12 = 


90z 

17 


+ 


126 

17 


9x = -10>' - 12 = 


X — 0 _ y + 6i5 
1/9 -1/10 

Jc - 0 _ y+ 615 
-10 9 


90z - 126 
17 


z- 7/5 
-VI 190 
z - 7/5 
17 


(15) 

(16) 


Problem Set 2.4 

1. Prove by vectors that the diagonals of a rhombus meet at right 
angles. 

2. Prove by vectors that the line segment joining the midpoints of two 
sides of a triangle is parallel to the third side and its length is one-half 
the length of the third side. 

3. Find the direction cosines of the line passing through the points 
i4U.2, 1) and J(3,- 1,-1). 

4. Find the vector equation of the line passing through two given 
points. 

5. Prove that the points A, B, C are colUnear iff OC aOA -I- 
where « + p — 1. 
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6. Prove that the perpendicular distance from the point P to the line 

r =• r + /» is I p + ~ *') ' . * 1 , _ • 

7. Find the angles between the lines 

jc — a y — b z —c x — a' y — b' z — c' 

I ~ m ii ’ T ml ““ In' ' ' 

8. Find the angles that the vector » = 2i — 2j + k makes with the 
coordinate axes. 

9. Find the equation of the plane perpendicular to the vector h 2i 
+ 3j + 6k and passing through the terminal point of the vector 
i+5j+ 3k. 

10. Determine a vector perpendicular to the plane containing the vectors 
u = 2i — 6J — 3k and v = 4i + 3j — k. 

1 1 . Find the angle between the planes 

(a) 2x — y + 2z = I and x — y = 2 

(b) 3x + 4y — 5z — 9 and 2x + 6y + 6z = 7. 

12. Prove that tile distance of the point y^f, r,) fiom the plane 
ax + by + cz + d = 0 is 

1 gJfp 4- by^ + cgp -f d [ 

Va® + h® + c* 

13. Prove that the equation of the line of intersection of the planes 

4x + 4^ — 5z = 12 and 8* + 12;' — 13z — 32 can be written in 

the form 

X— 1 y — 2 _ z 

2 ~ 3 ~ T ■ 

14. Prove that the equation of the sphere of radius r with centre 

PUi. >'i. ^i) is (* - *i)® + iy - yiY + (r - ZiY = r\ 
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Vector Spaces 


In Chapter 2 we saw that the set of ail plane (space) vectors forms a 
commutative group relative to addition and, further, relative to scalar 
multiplication it satisfies certain properties (Properties 2.2.7). All these 
properties of vectors are so fundamental in mathematics that whenever 
any system satisfies them we give it a special name, namely, vector space. 
The precise definition of a vector space follows. 

\ 

3.1 VECTOR SPACES 

3.1.1 Definition A nonempty set V is called a real vector space (or a real 
linear space or a real linear vector space) if the following axioms are 
satisfied : 

VSl There is a binary operation '+’ defined on K, called 'addition*. 

VS2 There is a scalar multiplication defined on V. (This means, to 
every real number a and every element u of V, we Can associate a 
unique element of V and denote it by a« ) 

V33 Addition and scalar multiplication satisfy the following : 

(a) P’ is a commutative group for addition (i.e. Gl, G2, G3, and G4 
hold for addition in V). 

(b) o(u + v) = aw + ov and (« + P)w = ow + flw for all real 
numbers a, ^ and all u, v £ V. 

(c) a(^u) s (aP)u p(au) for all real numbers a, p and all 
u£V. 

(d) la = w for all w £ V. 

3.1.2 Remark A complex vector space is defined analogously by using 
complex numbers instead of real numbers in Definition 3.1.1. 

3 1.3 Rmnark The real or complex numbers used for scalar multiplication 
in the definition of a vector space are called scalars.. Throughout 
we shall deal with only real vector spaces and complex vector 
spaces. 
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la Chapter 2 we saw that F, and f'g have addition and scalar multipJi* 
cation defined on them and VS3(a) holds for addition in both (Theorem 
2.2.5); and that (b), (c), and (d) of VS3 hold for scalar multiplication in 
V, and (Properties 2.2.7). Since these properties of plane vectors and 
space vectors have been abstracted to provide the general definition of a 
vector space, we shall hereafter use the word ‘vector’ to mean ‘an element 
of a vector space’. In other words, elements of a vector space shall be 
called vectors. Plane vectors and space vectors are only specific cases. 

3.1.4 Remark Note that here we have not used a, v, w for denoting 
vectors as we did in Chapter 2. We shall consistently use the letters 
u, V, w, ... for vectors, and the Greek letters a, p, y> ••• ^nr scalars. 
However, we use the boldface 0 to denote the zero vector of the 
space to distinguish it from the scalar ‘zero’. 

dearly, and are vector spaces. There are many other examples 
of vector spaces. We shall note a few of them here. In fact, the reader 
should be able to visualise several vector spaces before we go deeper into 
the subject. Visualisation of a vector space involves five steps : 

(i) Consider a nonempty set Y. 

(ii) Define a binary operation on V and call it ‘addition’. 

(iii) Define scalar multiplication on F as described in VS2. 

(iv) Define equality in V. 

(v) Check whether (a) to (d) of VS3 are satisfied relative to the 
addition and scalar multiplication thus defined. 

Example 3.1 Let V„ be the set of all ordered n-tuples of real numbers. 
Thus, an element of would be of the form (jCj, jt*. ..., jf„), where the 
x/s are real numbers. Define addition, scalar multiplication, and equality 
in F, as follows : If « = (x^, x*, .... x„) and v = (y,, y^, .... y„) are two 
elements of F„, then : 

Addition 

« + V = (xj + yi, X, + y„ .... x„ + y„) . (1) 

(Note that « + v G F„ because the right-hand side of Equation (1) is an 
ordered it-tuple of real numbers. This is called coordinatewise addition.) 

Scalar multiplication For a real" scalar a, au is defined as the ordered 
n-tuple («Xi, a.v„ ax„), i.e. 

«« •«= (axi, «x, axn) , (2) 

which is again in F„. (This is called coordinatewise scalar multiplication.) 

Equality u = (x^, x, x«) and v « (y,, y* y,) are defined as 

equal if x, =» y„ f = 1, 2, ..., n 

Since addition, scalar multiplication, and equality in F« have been 
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defined, what remains is to check whether (a) to (d) of VS3 are satisfied. 
We shall leave most of this checking to the reader. However, in order to 
give him an idea of what such checking involves, we shall now go through 
some of the details. 

CommutativUy of addition 

Let u = (xi, x„) and v = (y^, y^, y^) be two members of F,. 

Then « + v = ..,*« + >«) 

and V + M = + Jfg y„ f x,) . 

The real numbers x* + and j'* + are equal, since the commutative 
law of addition holds for real numbers. As this argument is true for 
every k, it follows from the definition of equality that « + v = v + k. 

The alert reader would have now noted that, fundamentally, it is the 
commutative law of addition among real numbers that gives the commuta* 
tive law of addition in F,. If this fact is remembered, we can check that 
If y = V -f u even mentally. 

Existence of additive identity 

We have to detennine an element 0, which has the property 
0 + w u. In this case we find that 0 » (0, 0, .... 0), because 
(0, 0, ..., 0) f (Xi, Xj, .. , x„) = (Xi, Xj, .... x„) for all (x^, x,, ..., x,) 
e F„. 

Existence of additive inverses 

Here we have to determine an element — u for the vector u C'F, such 
that — u -I- M = 0 = (0, 0, .... 0). If « = (xi, X*, ..., x,), then we can 
easily see that —u = (— JCi, — Jfg, ..., —x„). 

We assume that the reader can check the remaining properties. Once 
(a) to (d) of VS3 are checked, it follows that F„, for the addition and scalar 
multiplication defined in (1) and (2), is a vector space. 

It may be noted that, by Theorem 1.6.3. 0 = (0, 0, ..., 0) is the unique 
zero of the space and — « = (— *i, — ..., — ■^«) is the unique negative 
of « = (Xj, Xa X,). 

Thus, Fn is a real vector space, since we have used only real scalars. 
Can we use complex scalars in this case? No. 'For, suppose cc is a 
complex number. Then au «= (<xxi, ocx„ .. , oXn) is not in Fn, because 
the numbers oXk are complex and F. contains only n-tuples of real nntnbers; 
so scalar multiplication is not defined. See, however, I^oblem 2. 

Hie special cases n n 2 and n » 3 of Example 3.1 give us the vector 
spaces Vt and F,. The special case n » 1 gives the space . F^, which is 
untiling but the space of real numbers, where addition is the ordinaiy 
addition trf* teal numbers and scalar multiplication is the ordinuy multi* 
idication of real numbers. 
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Example 3J Let ^(1) be the set of ail reai'Valued functions defined on 
the interval I. With pointwise addition and scalar multiplication (cf § 1 .7), 
7(/) becomes a real vector space. The zero of this space is the function 
0 given by 0 (jc) = 0 for all * G 7. 

Example 3.3 If, instead of the real-valued functions in Example 3.2, we 
use complex valued functions defined on 7 and pointwise addition and 
scalar multiplication, then we get a complex vector space (using complex 
scalars). We denote this complex vector space by Sr c(7). 

Example 3,4 Let ^(7) denote the set of all polynomials p with real 
coefficients defined on the interval 7. Recall (cf Example 1.39) p is a 
function whose value at x is 

p(x) = «o + a^x + ... + for all * G 7, 
where a^’s are real numbers and it is a nennegative integer. Using point- 
wise addition and scalar multiplication as for functions, we find that £i‘(7) 
is a real vector space. If we take complex coefficients for the polynomials 
and use complex scalars, then we get the complex vector space iPc(l)- In 
both cases the vector 0 of the space is the zero polynomial given by 
0(x) = 0 for all X G 7. 

NOTATIONS 

^ \a, b] = the set of all real-valued functions defined and conti- 
nuous on the closed interval [a, h]. 
b] — the set of all real-valued functions defined on [a, h] and 
whose first derivatives are continuous on [a, h]. 

9f h] as the set of all real-valued functions defined on [a, h], 
differentiable n-times and whose n-th derivatives are 
continuous on [a, b\. These functions are called n-times 
continuously differentiable functions. 

Example 3.5 ^\a, h], ^ <*'[o, h], ^ <">[<!, i] are real vector spaces under 

pointwise addition and scalar multiplication. We have to use the fact from 
calculus that the sum of two continuous (differentiable) functions is conti- 
nuous (differentiable) and any scalar multiple of a continuous (differenti- 
able) function is continuous (differentiable). 

By changing the domain of definitions of continuity and differentiability 
to the open interval (a, h), we get, similarly, the real vector spaces ^ (a, h) 
and ^^*‘\a, b) for each positive integer n. 

3.1.5 Remark By changing real-valued Ainctions to complex-valued func- 
tions and using complex scalars, we get the complex vector spaces 
^cl«,h]and ^c(fl.h). 

3.1.5 Remark In each of these cases the reader should convince himself 
that the sets concerned are Wector spaces’ under the definitions 
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mentioned. He should check the axioms in each case until he reaches 
the stage where he can quickly say whether the axioms are satis- 
fied or not. In any case no axiom should be taken for granted. In 
all cases the zero element of the space and the negative of any given 
element of the space should be clear in the reader’s mind. 

Example 3.6 Let b\ stand for the. set of all functions defined 

on [a, h] and having derivatives of all orders on [a, h]. This is a real vector 
space for the usual operations. It is called the space of infinitely differenti- 
able functions on [a, h]. 

We conclude this article with a theorem giving certain immediate conse- 
quences of the definition of a vector space. Recall that, in the definition 
of a vector space, we have property (d) of VS3, namely, \u — ti for all 
u £ K. It should be noted that this apparently trivial axiom is crucial'to 
the development of the theory of vector spaces. 


3.1.7 Theorem In any vector space V, 

(a) aO «= 0 fyr every scalar a. 

(b) Ou = 0 for every u £ V. 

(c) (— 1)« •“ — u for every u£ V. 

Proof : (a) aO — a(0 -f- 0) (by G2) 

=i aO -H «0 (by VS3(b)). 

Adding — («0) to both sides, we get 
0 = — («0) -f- (aO -f aO) 

= (-(oO) -f- (aO)) + aO (by Gl) 

= 0 -I- «0 (by G3) 

= aO (by G2). 

(b) 0« = (0 + 0)« s= 0« + Ott (by VS3(b)). 

Adding — (Ou) to both sides, we get 

0 - -(Ott) + (Ott + Ott) - (-(Ott) + (Ott)) + Ott (by Gl) 

= 0 4- Ott - (by G3) 

= Ott (byG2). 

(c) (-l)tt -f- tt = (— l)tt + Itt (by VS3(d)) 

= (-1 -I- l)tt (by VS3(c)) 

« Ott » 0 (by (b)). 


So by G3 and the uniqueness of the negative, (— l)tt is the negative of u, 
i.e, (— l)tt — -tf. I 

It is convenient to write tt — v for a -i- (— v). 
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Problem Set 3 1 

1. Let = (1, 3, 2, 7), «a — (0, 2, —3, 5), Mg =- (—1, 3, 1, —4), and 
1/4 = (—2, 16, — 1, 5) ^ vectors of K*. Then evaluate 

(a) Ui + «s (b) 2«4 3mj — 71/4 (c) «, + 2«s + Bug — «4 

(d) 3u2 + (M4 -«i) (e) (aui—buj) 4- a«j. 

2. Consider the set F’S of all ordered /i-tuples of complex numbers. By 
defining equality, addition, and scalar multiplication (with complex 
scalars) as in prove that is a complex vector space. Is it a real 
vector space ? 

3. Let Ji+ be the set of all positive real numbers. Define the operations 
of addition and scalar multiplication as follows : 

• « + V =■ M • V for all «, V G 

OLU = tfl for all M £ and real scalar a. 

Prove that i$r real vector space. 

4. Which of the following subsets of are vector spaces for coordinate- 
wise addition and scalar multiplication ? 

The set of all vectors (Xj, Xj, Xg, Xg) G Kg such that 
(a) Xg = 0 (b) Xj = 1 (c) Xg > 0 

(d) xl > 0 (e) xf < 0 (f) 2xi -h S.Xg =■ 0 

(g) + i^s - 3.X3 + Xg = 1. 

5. In any vector space prove that a.u = 0 iff either « = 0 or 1/ = 0. 

6. Which of the following subsets of ^ are vector spaces ? 

The set of all polynomials p such that 

(a) degree of p n (b) degree of p = 3 

(c) degree of p > 4 (d) p(l) = 0 

(e) p(2) = 1 (f) p'(l) = 0 

(g) p has integral coefiicients. 

7. Which of the following subsets of ^ [0, 1] are vector spaces ? 

The set of all functions / G ^[0, 1] such that 

(a) /(1/2) - 0 (b) fOI4) = 1 

(c) /'(X) - x/(x) (d) /(O) - AD 

(c) /(x) ss 0 at a finite number of points in [0, 1] 

(f) /has a local maxima at X = 1/2 
/has a local extrema at X » 1/2. 

8. Let K be a real vector space and X an arbitraiy set. Let be the set 
of all functions f: X -*■ V. Prove that V* is a real vector q>aoe for 
pointwise addition and scalar multij^ication, where definitions are 
analogoos to those for real>valued fufictions. 



3.2 SUBSPACES / 69 


9. True or false? 

(a) In a vector space K, (— 1) (—u) = u for all « £ K. 

(b) In a vector space I', --m — v =» —v — for all «, v £ K 

(c) In a vector space V, ~u — v *= -(u-^ v) for all «, v £ F. 

(d) In a vector space V, — (— w) = u for all n £ F. 

(e) /{ X IS a vector space. 

(f) If the scalars are complex numbers, then 7(f) is a complex vector 
space. 

(g) In C, the set of complex numbers considered as a complex vector 
space, if a • 1 -f pi = 0, then a = 0 = p. 

3.2 SUBSPACES 

3.2.1 Definition Let 5 be a nonempiy subset ot a vector space F. S is 
said to be a subspace of F if 5 is a vector space under the same 
operations of addition and scalar multiplication as in F. 

In order to understand this definiiion as well as the future concepts in 
the subject, we shall repeatedly consider the concrete cases of F, and F,. 

F, IS the Euclidean plane. Take any straight line 5 through the origin 
O. Any point P on this straight line can be considered as a vector OP of 
F, in S. The sum of two such vectors OP and OQ, where P and Q both 

lie m S, is again a vector OR, where R lies in S. Similarly, a scalar multi* 
pie of any vector in S is again a vector in S. All other axioms of a vector 
space are automatically satisfied in S. So 5 is a vector space under the 
same operations as in F,. Thus, S' is a subspace of F^. In other words, every 
line through the origin is a subspace of Ft. 

In the same manner, in F, we find that any plane S through the origin 
18 a subs^e of F,. Also, every straight line L through the o^gin is a sub- 
space of F,. The following examples further illustrate the concept of a 
subspace. 

Example 3.7 Let L be the set of all vectors of the form (x, 2 x, — 3x, x) 
in Vt. Then L is a subspace of F 4 . 

Proof : If B = (X, 2x, — 3x, x) and v = (y, 2y, — 3y, y) are two elements 
of L, then clearly 

« + » (x+y, 2(x + y), -3(x + y), x - 1 - y) 

■ad oat («x, 2 («x), — 3 (otx), otx) 

■too belong to L, The zero element (0, 0, 0) is also of Uiis form and 

hence belongs to L. The negative of « is — « *■ (— x, — 2x, 3x, — x), 
which to again of the same form and hence belongs to L, The other laws 
of associativity and commutativity for addidoo, ditiributive laws, and the 
final axtom In «> n are all true in L, because etoments of L are elementa 
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of y*, and m V^ a\\ these \aws are true. Thus, L is a subspace of F*. Tn 
fact, L is the ‘line’ through the point (I, 2, —3, 1) and the origin 
(0, 0, 0, 0) in f't. 

Example 3 8 Generalising Example 3.7, we can say that all scalar multi* 
pies of a given element of a vector space F form a subspace of F. 

Proof : Let the set of all scalar multiples of Uq be denoted by [«o] ■ If and 
V are two vectors in [uj, then u = nUg for some a and v = for 
some p. 

li + V =* aw, + Pm, = (a + P)m,, i.e. u + v is a scalar multiple of 
u,. Hence, u + v E [u,]. Again, Am = A(aM,) (Aa)M„ i.e. Au is also 
a scalar multiple of u,. Hence, Am E [m,] for all scalars a and u E [u,]. 

0 £ (mo 1» because 0 = Om, by Theorem 3.1.7. If m E [mJ, then 
— M = (— l)Mby Theorem 3.1.7, and so — m E [mJ. The other axioms, 
which are only interrelations, are true for all elements of K and so are 
true for all elements of [m,]. Hence, [m,] is a subspace of V. 

Example 3.7 is a special case of Example 3.8. The subspace of 
considered in Example 3.7 is just [(1, 2, —3, 1)]. 

In these examples we note that to prove that 5 is a subspace of V we 
explicitly checked only the following : 

(i) The sum of any two vectors in S is again in S, i.e. addition is 
closed in S. 

(ii) The scalar multiple of any vector in S is again in S, i.e. scalar 
multiplication is closed in S. 

(iii) The existence of 0 in 5 and the existence of a negative for each 
element in S. 

The other axioms were not explicitly checked, because this, as the 
following theorem shows, was not necessary. In fact, the theorem says 
that even (ii^ need not have been checked. 

3 . 2.2 Theorem A nonempty subset S of a vector space V is a subspace of 

V iff the following conditions are satisfied : 

(a) Ifu, V E iS, then m -}- v E S. 

(b) If u S S and a a scalar, then otu E S. 

In other words, a subset 5 of a vector space K is a subspace of K it 
is closed under addition and scalar multiplication defined in V. 

Proof : Let f be a subspace of V. Then is a vector space under 
the same operations as those of V. Hence, S satisfies (a) and (b). Con- 
versely, if (a) and (b) are satisfied, then we have to prove that S satisfies 
all the axioms of a vector space. VSl and VS2 are satisfied for S, 
because this is exactly what (a) and (b) say. We shall now show that 
VS3 for S follows from VSl and VS2 for S. 
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Ou as 0 for any « £ K and therefore for any ir, £ S. Taking any 
«b G <S. we see that, from (b), 0 = Om® £ S. Similarly, (— 1)« = —u 
for any u E. V and therefore also for a given Uy £ 5. Hence, — £ S 
for every Uo G S. Thus, G2 and G3 hold in S. 

Axioms Gl, G4, and (b), (c), and (d) of VS3 are automatically satisfied 
for elements of S, since these laws already hold for elements of F. Note 
that this needs no checking, because these axioms are interrelations of the 
elements. In the cases of G2 and G3 the checking was necessary, because 
we bad to show the existence of certain elements in S. | 

3.2.3 Remark In view of Theorem 3.2.2, whenever we want to prove 
that a set S for certain operations is a vector space, we try to look 
at iS as a subset of V, where K is a vector space and the operations of 
addition and scalar multiplication in S are the same as the opera- 
tions in y. Once wc have done this, it is enough to prove that the 
operations are closed in S. 

Example 3.9 Take %^\a, b\ of Example 3.5. [a, b] is a subset of 

i], which is a vector space by Example 3.2. So to prove that 
^[a, fr] is a vector space (which we have done in Example 3.5), it is 
enough to prove that [a, b\ is a subspace of y[a, 6]. Therefore, by 
Theorem 3.2.2, we only need to prove that [a, is closed for addition 
and scalar multiplication. 

Since the sum of two continuous functions is continuous and any 
scalar multiple of a continuous function is again continuous, we find that 
addition and scalar multiplication are closed in '55^ [a, ft]. This observa- 
tion not only proves that ^ [a, b] is a vector space, but also that it is a 
subspace of y[a, b], 

3.2.4 Remark The spaces b], ^1. ^1. and 9’la, b] 

ate subspaces of 7[a, b\. 

Further, note that 

(a) b] is a subspace of '^[a, b]. 

(b) b] is a subspace of ^ [a, b]. 

(c) h] is a subspace of b] for every positive integer n. 

(d) b] is a subspace of b] for every m <n. 

(e) 9[a, b\ is a subspace of b] for every positive integer «. 

(f) Similar results are true for functions defined on (a, b). 

Example 3.10 The set 5 of all polynomials p £ 9, which vanishes at a 
fixed point jCq, is a subspace of 9. 

We have S - {p G ^ 1 pW “ 0} . 

If p and q are two members of S, then p(Xo) « o and qfpt^ 0. So 
(p + g)(xe) » p(Xo) + 9(Xo) 0, which means that the polynomial 

p + q also vanishes at and sop + q G S. So addition is closed in S. 
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Similarly, if a is a scalar and p & S, then (ap) (Xq) » a(/r(xt)) • 0 «= 0. 

So (ftp ^ S. This completes the proof that 5 is a subspace of 9*. 

Before concluding this article, we shall identify what are called trivial 
subspaces of a vector space V. The set containing just the zero element 
of V and nothing else is clearly a subspace, since it satishes conditions (a) 
and (b) of Theorem 3.2.2. Similarly, V, itself considered as a subset of V, 
satisfies the conditions of Theorem 3.2.2 and so is a subspace of itself. 
These two subspaces {0} and V of V are called trivial subspaces of V, since 
they trivially satisfy conditions (a) and (b). All other subspaces of V are 
called nontrivial subspaces of V. The trivial subspace {0} of V is denoted 
by Kq and is also called the zero subspace of V. 

Example 3.11 Consider the equation 

+ <hXi h .. + »nX„ =» 0 . (1) 

where a/s are real constants and x,'s arc real unknowns. A solution of 

this equation can be represented as an n-tuple (x^, Xj x„), which is a 

vector of V^. Now let S be the set of all vectors (Xj, x*, ..., Xn) £ 
which satisfy Equation (1). We can prove that S is a subspace of The 
proof is left as an exercise for the reader. 

The special cases of Example 3.1, when n 2 or n — 3, are interest- 
ing. Take Fj. The set S of vectors (x, y) £ F,, which satisfy the equa- 
tion ox -f py 0, is clearly a straight line through the origin in F,. 
It is therefore a subspace of F,, as pointed out in the discussion following 
Definition 3.2.1. This is now corroborated by the general case considered 
in Example 3.11. 

Again, in V, the set S of all vectors (x, y, z) £ F„ which satisfy the 
equation ox -I- py -f = 0, is a plane through the origin and hence a 
subspace of V 3 (also explained in the discussion following Definition 3.2.1). 
This fact is now corroborated by the result in the general case. 

Finally, suppose in F, we consider the set S of all vectors (x, y, z), which 
satisfy the equation oix 4- py -f- =* 1- This, of course, is a plane, but 

since it does not contain the vector (0, 0, 0), the zero of the space, it is not 
a subspace. 

From the foregoing argument we can see that to prove that a given set 
is not a subspace (when it is not !) is really easy. For, from among the 
several axioms that it has to satisfy we choose one that is not satisfied by 
it and we are done. For example, in the previous paragraph, it is obvious 
that (0, 0, 0) does not belong to the set and this observation alone is 
enough for us to conclude that the set is not a subspaoe. 

Problem Set 3.2 

1. Prove that conditions (a) and (b) of Theorem 3.2.2 can be teplgped 
by the single condition 
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ou + pv £ 5 for all u,v & S and all scalars a, 

2. UtW ^ {(*1, Xt , .... G K, 1 Xi =* 0}, Prove that »Fis a SUb- 
space of P,. 

3. Prove that 

^ ~ {(^n •• > I "I" "f" ... "I" ^Xfi = Of 

a,’s are given constants} 

is a subspace of V^. 

4. Which of the following sets are subspaces of P*? 

(a) fCXit ^3) I =3 0} 

(b) {(*1, x*. X3) I ^ = ^/2} 

-Yl 

fc) {(Xj, Xj, X,) 1 V2Jti = VBx*} 

(d) {Cxi, Xj, X3) 1 X3 is an integer} 

(e) {(x„ X,, Xj) I xf + xi + X®, < 1} 

(f) {(xi, Xj, Xj) 1 X, + Xj + Xa > 0} 

(g) {(->^ 1 . *a. 1 V2x, and x, =- 3xj} 

(h) {(x„ X,, X3) 1 Xi = 2xa or X3 = 3x,} 

(0 {(Xi, X,. Xj) I X, - 2Xj = X 3 — . 

5 Which of the following sets arc subspaccs of i/ ’ 

(a) {p G i/* i degree of p = 4} 

(b) {p G ^ 1 degree of p si 3} 

(c) {p E 9 \ degree of p > 5} 

(d) {p G 1 degree of p ■is, 4 and p'(0) - 0} 

(e) {p G • P(l) = 0}. 

6. Which of the following sets are subspaces of (a, b) ? 

(a) {/G (a, b) I Ax^) = 0. X3 G (o. b)) 

(b) {f^Z («• *) 1 ® ^ ^ 

(c) {/ G <l (fl, b) I /( - 1} 

(d) {/G '^(a, *) l/'W = x^ fix)) 

(e) {/G ^^(a, b) I 2/'''(x) + 3x/''(x) - fXx) + x*/(x) = 0} 

(f) {/G '?r(a,i)l/*/(x)dx - 0}. 

7. Prove the statements in Remark 3.2.4. 

8. (a) If U and IP are subspaces of a vector space P such that V O IP, 

then prove that Cf is a subspace of IP. 

(b) If IP is a subspace of a vector space P and Cf is a sutepace of IP, 
then prove that If is a subspace of P. 

9. True or false 7 

(a) In Pi every infinite subset is a subspace. 
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(b) F] is a subspace of P3. 

(c) X F, = F,. 

(d) Every subspace of a vector space is a vector space. 

(e) Fg is the only real vector space containing a finite number ot ele- 
ments. 

(f) The derivatives of e* form a vector space. 

(g) The set {x sin x + P cos x | a, ^ are real numbers} is a vector 
space. 


3.3 SPAN OF A SET 


In Example 3.8 we saw that an element i/q of a vector space F gave rise 
to a subspace [uo] of Looking at it another way, we can say that here 
is a subspace of F, namely, [uo]> that is fully identified once we know the 
single element Uq. In this article we shall see subspaces that are fully 
identified by a subset of F, which is smaller than the subspace. To be more 
precise, we need the following definitions. 

3.3.1 Definition Let Mj, i/j, .. , be n vectors of a vector space F and 
let ttj, Xj, ... , be « scalars. Then 

*1^1 *4" “4“ ••• “f 

is called a linear combination of u^, u ^, ..., u,. It is also called a linear 
combination of the set S = {«,, Wj, ..., «„}. This being a linear combi- 
nation of a finite set is also called a finite linear combination 

In the case of an infinite set iS^ a linear combination of a finite subset 
.4 of iS^ is referred to as a finite linear combination of S. 


3.3.2 Definition The span of a subset 5 of a vector space F is the set of 
all finite linear combinations of S. 

In other words, if .S' is a subset of F, the span of S is the set 


{■ 


+ «I«S + — + 


«], X any scalars, n any posi- 


} 


tive integer, and u^, «*, ..., «„ e 
The span of S is denoted by [5]. If S contains only a finite number of 
elements, say U}, 1^, ..., then [S] is also written as [ui, Uj, ..., uj. 


As illustration, take F =* F3 and S = {(1, 0, 0), (0, 1. 0)}. Any linear 
combination of a finite number of elements of S is of the form x(l, 0, 0) 
-b P(0, 1, 0) => (a, p, 0). The set of all such linear combinations is [5]. 
Actually, [5] p, 0) | x, ^ any scalars}. In this case [5] can be written 
also as [(1, 0, 0). (0, 1, 0)]. We can see that it is a subspace of F,. In fact, 
this is true in all cases. We shall state and prove this assertion in the 
form of a theorem. 

3J.3 Theorem Let S be a nonempty subset of a vector space V. Then [5], 
/Ae span of S, is a subspace of V. 
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Proof : By Theorem 3.2.2, we Bhve only to prove that [51 is closed 
for addition and scalar multiplication. Let u and v be any two vectors in 
[S]. Then 

u = KjiMj + + ... + for some scalars o<, some 

»<’s £ S, and a positive integer it, 

and V — PjVj + PjV, + ... + p*v* for some scalars Pi, some 
vectors v^’s £ S, and a positive integer m. 

Hence, u + x^Ui + ... + + p^Vj + ... f p„v„. This is again 

a finite linear combination of S and so u + v £ [jS]. Similarly, 
«« s (aai)iii + ... 4- (oM„)u„ is again a finite linear combination of 
S and so it is in [5J. Hence, [i$] is a subspace of V. | 

3.3.4 Remark A nontrivial subspace always contains an infinite number 

of elements. So [5] always contains an infinite number of ele- 

ments. But S itself may be a smaller set, even a finite set. By con- 
vention, we take [<)>] >= Kq. 

3.3.5 Theorem If S is a nonempty subset of a vector space V, then [S] is 
the smallest subspace of V containing S, 

Proof : Clearly,' [S] is a subspace by Theorem 3.3.3. It contains S, 
because each element u^ of S can be written as lu^, i.e. a finite linear 
combination of S. To prove that [<S] is the smallest subspace containing 
S, we shall show that if there exists another subspace T containing S, then 
T contains [5] also. 

So let a subspace T contain S. We have to prove that T contains [5]. 
Take any clement of [5]. It is of the form a^t/, + aj«j + ... + where 
a,'s are scalars. Ui, Ug, .... u„ are in S, and n is a positive integer. Since 
S C T, each n, also belongs to T. Since T is a subspacc, XiUi + a,tt, + ... 
+ a„tin should also belong to T. This means that each element of [5] is 
ini'. I 

Example 3.12 In show that (3, 7) belongs to [(1, 2), (0, 1)], but does 
not belong to [(1, 2), (2, 4)]. 

Clearly, (3, 7) belongs to [(1, 2), (0, 1)], if it is a linear combination of 
(1, 2) and (0, 1), i.e. if 

(3, 7) = «(1, 2) + P(0; 1) = (a, 2a, +P) 
for some suitable a and p. This is possible only if 

a = 3, 2a + p = 7. (1) 

Solving Equation (1), we get a = 3, p =* 1. Thus, (3, 7) =» 3(1, 2) + 
1(0, 1). Hence, (3, 7) £ [(1, 2), (0, 1)]. 

Further, it (3. 7) £ [(1, 2). (2, 4)], then 

(3, 7) « a{l, 2) + p(2, 4) = (a + 2p, 2a + 4p) . 
for some suitable a and p. This gives 

a + 2p - 3, 2a + 4P - 7. 


( 2 ) 
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But these equations cannot hol^at the same time. So (3^7) $ [(1, 2), 
(2. 4)1. 

Example 3.13 In the complex vector space Ff show that (1 + /, 1 — /) 
belongs to [(1 + i, 1), (1, 1 — /)]. 

[(1 + I. 1). (1,1-/)]= {«(! + /. 1) + p(l. 1 - I) 1 «, P complex scalars} 
= {(« + P + oi, « + p — PO 1 a, p complex scalars). 
(1 + /, 1 - 0 belongs to ((1 + /, 1), (1. 1 - /)} if 

(1 + /, 1 — 0 = (« + P + */. « + P - P*> 
for some scalars a, p. Thus, 

p-|-flti = ot(l -f* /) -{- p 
1 — / — a + p — pi = a + P(1 — i) , 

Solving for o, p, we get a = 1 + i, p = 1 — i, showing that (1 + i, 
1 — 0 belongs to [(1 + i, 1), (1, 1 — 0]- 

Problem Set 3.3 

1. Let 5 s {(1, 2, 1), (1, 1, —1), (4, 5, —2)). Determine which of the 
following vectors are in [5] : 

(a) (0, 0. 0) (b) (1, 1, 0) (c) (2. -1. -8) 

(d) (-i. -i.i) (e) (1,0,1) (f) (1. -3,5) 

2. Let S — {x®, X® + 2x, x* + 2, 1 - x>. Determine which of the follow- 
ing polynomials are in [iS] : 

(a) 2x» -I- 3x® -1- 3x 4 7 (b) x* 7x + 2 

(c) 3x*-l-x-l-5 (d) + ^ 

(e) 3x + 2 (f) x» + :«* + 2x + 3. 

3. If 5 is a nonempty subset of a vector space K, prove that 

(a) [iS] ** S Iff Sis i subspace of V 

(b) ttfl] » [S]. 

4. Let Vi, Vt be n elements of a vector space V. Then prove that 

(a) IVl, V, V*] = KVi, «|V„ .... a,V„], OC, 0 

(b) (vi, vj - [v, - v„ V, + vj 

(c) If Vfc e (vj, Va, .... then 

^*-1, ^le+i» — [^1, ^ss, •*., ^*-1, ...» 

5. Let 5 be a nonempty subset of a vector space V and u, v £ F. If 
0 € U {v}] but u ^ [iS], then prove that v E [5 U {»}]. 

6. What is the span of 

(a) x-axis and ji-axis in F, ? 

(b) x-axis and ;i 9 »-plane in F, ? 
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(c) x^'-plane and ;'2:-planc in F, ? 

(d) x-axis and the plane x + y = 0 in F, ? 

7. True or false? 

(a) Span of x + = 0 and x — y = 0 in F, is F,. 

(b) Vj has a subspace consisting of 7 elements. 

(c) The span of the set {x, x*, x®, x*, ... } is 9. 

(d) In Fj, [y-axis U r-axis] = F,. 

(e) In Fa, [*] = [i. k, i f *] n [/, kj + k]. 

(f) In Ff, (-1, 2, 0) € I(i. -I. 1), (0, -I, -1)]. 


3.4 MORE ABOUT SUBSPACES 

Let U and W be two subspaces of a vector space F. Their intersection 
U C\ W cannot be empty, because each contains the zero vector of F. 

Now, if u and v are two vectors of U n IF, then m + v G U and 
tt + V G IF, because V and IF are subspaces of F and «, v both belong to 
U as well as IF. Hence, ti + v G Cf D IF. Similarly, if a is any scalar, 
then au is in both U and IF. Hence, an G H IF. This shows that if 
U and W are subspaces of F, then U C, W is also a subspace of V. 

This result can be generalised to any number of subspaces. More 
precisely, if £fj, t/g, .... are n sobspaces of F, then their intersection 

n U's n ... n is also a subspacc of F (see Problem 1). We shall 
use this fact in an interesting way in the following example. 

Example 3.14 Let W be the set of all vectors (x„ Xj, x„) of F„ satisfy- 
ing the three equations 

aiX, + OgX, + ... + a„x„ = 0 (1) 

Pl*l + + — + Pn^n = 0 (2) 

"I” ••• "i* Yn^n * 0 • (3^ 

Then IF =» IF, n IF, fl IF„ where IF, is the solution set of Equation 

(1), IFg is the solution set of Equation (2), and IF, is the solution set of 
Equation (3). Each IF, is a subspace by Example 3.11. So, by the foregoing 
argument, IF is a subspace of F„. 

Thus, we have proved that the intersection of two subspaces is always a 
subspace. On the other hand, the union of two subspaces need not a 
subspace. For example, take U = x-axis and IF = y-axis in F,. U and 
IF are subspaces of F,. Here (1, 0) G and (0, 1) G IF. So both (1,0) 
and (0, 1) belong to t/ U IF. But (1, 0) + (0, I) •= (1, 1) Cf U IF. 
This shows that If U IF is not a subspace of F,. 

Thus, If U IF is not in general a subspace. However, we know, by 
Theorem 3.3.5, that [If U IF] is the smallest subspace of V con tainin g 
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U \J W. Let us now analyse the subspace [U‘ U ffl- Any element of 
this subspace is a linear combination of a finite subset of 17 U In other 
words, a vector v of f 17 U if'J is of the form 

p = it^Ui + ... + + ft»i + ... + i3»ww, ^4; 

where v^*s £ U, w,*s G ff', n and m are nonnegative integers, and a’s, P’s 
are scalars. But «i«j + ... + is a vector in 17 and piWj + ... + PmWn 
is a vector in W. Therefore, v can be expressed as t/ + iv, where u G U 
and w G W, So we can say that [C' U W] conc’sts of elements of the form 
« 4- w, « G V, and vt G W. 

3.4.1 Definition (Addition of sets) Let A and B be two subsets of a vector 
space V. Then the sum of A and B, written as A + B, is the set of 
all vectors of the form u + v,u G A, and v £ B, that is, 

A + B — {« + V 1 « e .4, V G B} . 

Example 3.15 In K* let A — {(1, 2), (0, l)j and B = {(1, 1), (— 1,2), 
(2. 5)}. Then 

A + B = {(1, 2) + (1. 1). (t, 2) + (-1, 2). (1. 2) + (2, 5), (0, 1) 

+ (1, 1), (0. 1) -^ ( -I, 2), (0, 1) + (2. 5}} 

== {(2, 3). (0, 4). (3, 7). (I, 2), (-i; 3), (2, 6)} . 

Example 3.16 In Fg let A — {(2, 3)}, B == {f(3, 1) 1 t a scalar^. Then 

A + B ^ {(2, 3) + r(3, 1) 1 1 a scalar) 

= {(2 + 3t, 3 + t) 1 r a scalar) . 

Geometrically, B is a line through the origin and i4 is a set containing 
one vector (Figure 3.1). .4 + B is a line parallel to B and passing through 
the point (2, 3). 



Example 3.17 In F, let A ^ {*(1, 2, 0) 1 a a scalar), B = {P(0, 1, 2) | p 
a scalar). Then 

A + B = {«(!. 2. 0) + p(0. 1, 2) I «, p scalars) 

= {(«, 2a, +p, 2p) I a, p scalars) . 

Geometrically, A apd B ate lines through the origin in F, and 41 + B 
is a plane containing these lines and passing through the origin (Figurw3.2). 
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In this case ^ -I- 2? = 1(1, 2, 0), (0, 1, 2)]. 



Figurb 3.2 


3 4.2 Theorem If U and W are two subspaces of a vector space V, then 
U \- W is a subspace of V and V + W [U \J fV]. 

Proof : Obviously, U + Wc.W\J W], because each vector oiU W 
is a finite linear combination of 1/ U W. We shall now prove that [U \J W] 
C U + W. Let V £ [t/ U IF]. Then the argument preceding Defim* 
tion 3.4.1 shows that v is of the form u + w, for some u ^ U and w £ IF. 
Hence, v £ If + IF. Thus, U W — [U \J W]. This amomatically 
makes tf + IF a subspace of F. | 

3.4.3 Remark From Theorem 3.4.2 it follows that Cf + IF is the smallest 
subspace of V containing U \J W, i.e. both U and W. 

Example 3.18 If F F„ Cf = jc-axis, and W = ^'-axis, then Cf + IF is 
the set of all those vectors of F, that are of the form a(l, 0, 0) + P(0, 1, 0). 
Therefore, U + W — {(a, P, 0) I a, p are scalars}. On the other hand, 
{U U fF] consists of vectors of the form au + Pw, where a, p are scalars. 
« £ If, w £ W. This gives 

[1/ U »F] =x {a(l, 0, 0) + P(0, 1, 0) I a, p are scalars} , 
which is the same as Cf + IF. This illustrates Theorem 3.4.2. Note the 
interesting relation arising from this example : 

[x-axis U >’-axisJ =* x-axis + J'-axis « xj>-plane. (5) 
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DIRECT SUM 

We have just seen that if U and W are subspaces of a vector space V, 
then the sum U W h also a subspace of V. If, in addition, V jr\ W 
— Fg as {0}, the sum U + Wis called a direct sum. The direct sum of 
U and W is written as U 0 IF. 

Example 3.19 We can check the following additions in F, : 


jc;K-plane + ^'^•plane = F, (6) 

x^'-plane -f z-axis = . (7) 

The sum in Equation (7) is a direct sum, because (xj'-plane) n z-axis 
— {0}. So Equation (7) can be rewritten as 

(x;'-plane) 0 (z-axis) = F, . (8) 

The sum in Equation (6) is not a direct sum, because 

(xy-plane) n (yz-plaat) = (y-axis) ^ {0} . 

Any vector (a, b, c) € F, can be written as 

(o, b, c) = (a, b, 0) + (0, 0, c) , (9) 


where (a, b, c) 6 xy-plane, (0, 0, c) £ z-axis. Thus, (a, b, c) is the 
sum of two vectors, one in the xy-plane and the other in the z-axis. The 
advantage of the direct sum lies in the fact that the representation (9) is 
unique. That is. we cannot find two other vectors, one in the xy-plane and 
the other in z-axis, whose sum is (a, b, c). The reader can check this for 
himself. 

On the other hand, in Equation (6) any vector (a, b, c) can be 
written as the sum of two vectors, one in the xy-plane and the other in 
the yz-plane, in more than one way, for example, 

(a, b, c) = (a, b, 0) + (0. 0, c) (10) 

and 

(a, b, c) - (a, 0, 0) -1- (0, b, c) . (11) 

The fact asserted in this example is generalised in the following 
theorem. 

3.4.4 Theorem Let U and W be two subspaces of a vector space V and 
Z ‘m U + W. Then Z = U @kW iff the following condition is 
satisfied : 

Any vector z & Z can be expressed uniquely as the sum 

z = « -1- w, a £ U, w £ IF. (12) 

Proof : Let Z — 1/ 0 IF. Since Z = 17 + IF, any vector z £ Z 
can be written as 

Z =a tt -1- W , (13) 

for some u £ 17 and iv £ IF. 

Suppose it is possible to have another representation 

z » «' + w' , 


(14) 
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for some ^ U and w’ E W. Then 

« + w = ti' + w' (14) 

or 

u — u' = w' — w . (15) 

But II — e U and w'— w G W. From Equation (IS), we find that 
u —i/ — w'— w 6 n IF == {0}, since Z is a direct sum of U and W. 
Hence, « — u' = 0 = w' — w, which implies that n = ii' and w = w'. So 
no such second representation for Equation (13) is possible. In other 
words, condition (12) is satisfied. 

Conversely, let condition (12) hold. We shall now prove that Z is 
a direct sum of U and W. Since Z = 17 + IF, we have only to prove that 
Un 1F={0}. 

Let, if possible, U f\W contain a nonzero vector v. Then v E C7, y E 
IF, and y = v-l-0Et7 + lF with v G £7 and 0 E IF. Also v == 0 + v E 
£7 + IF with 0 E £7 and v E IF. These two ways of expressing a vector v in 
U + W contradict the hypothesis (12). Hence, £7 n IF = {0} and Z = 
£7 0 IF. I 

3.4.5 Definition If £7 is a subspace of a vector space V and v a vector of 
F, then {y} f £7, also written as v + £7, is called a translate of V 
(by v) or a parallel of U (through v) or a linear variety. 

U is called the base space of the linear variety and v a leader. Note 
that {v} H- £7 is not a subspace unless v E £7. (Why ?) 

As illustration, take the line y = x through the origin in F,. Call it £7. 
Considei the point v = (1, 0). The translate v £7 of £7 by v is the line 
y — X — I through the point (1, 0) (Figure 3.3). It can also be obtained 
by adding (i, 0) to the vectors in y = x. 




Figure 3.3 

As a second illustration, take the plane y — OinV, and call it V. Con* 
shier the point v » (1, 1, 1) € F,. (1, 1 , 1) + £7 is the set of all points of 
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Kj given by (1, 1, 1) -)- m, where « £ I/. Geometrically, it is the plane 
.parallel to y — 0 through the point (1, 1, 1) (Figure 3.4). 



The following theorem gives the fundamental properties of a linear 
variety. 

3.4.6 Theorem Let U be a subspace of a vector space V and P = v -\-U 
be the parallel of U through v. Then 

(a) for any w in P, w + U = P. In other words, any vector of P can 
be taken as a leader of P; 

(h) twj vectors v^, v* € K are in the same parallel of U tff Vj - Vj e U. 

Proof : (a) Let w be a vector of P. Since P = v + U,w can be express- 
ed as v + tti for some «i £ £/. So w = v -f Mi or, equivalently, v = w — m,. 

Let z €. P- Then z has the expression z = v + «» for a suitable £ U. 
iince V = w — we have z = {w — Ui) + ^ w {u, — Uj). Here 

«» — «i G U. Thus, every vector z of P has the form w + (some vector 
in V). So P C w -h U. Conversely, let y £ w -f- tf. Then y is of the 
form y = w + M for a suitable u G.U. The vector y = w-|-M = v-|- 

(ui + «) is of the form v + (a vector of V). So y £ v + t/ == P. This 

shows that w + U C P. Hence, w + U — P. 

(b) Let Vi, V, be in the same parallel of U, namely, p + (/. So 

s V + U] for some £ U, and v* = v + Uj for some u^ £ U. Then 

Vj — Vj = (p + «,) — (p -H tt.) = Hi — Uj, which belongs to U. Con- 

versely, if Pi — Pi £ U, then Pi — p* = w for some uG. U. So 
Vj p, -)- u. Therefore, Pi £ p* + U. Also p» = p» -I- 0. Therefore, 
p, £ Pa 4- U, since 0 £ C/. So Pi and Pt belong to the same parallel 
V. + f/. ■ 

As illustration, take V = and U = yz-plane. Let p = (1, 1, 1). 
Then P » p 4- If is the parallel given by the set 
{(1, 1» 1) + (0, P, y) I P. Y arbitrary scalars} 

— ^(1, 1 4- P, 1 4- y) I P. Y arbitrary scalars}. 
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Part (a) of Theorem 3.4.6 says that to describe this set we could take 
instead of (1, 1, 1 ), any other vector from P. Let us take vector (1, 0, 0), 
which is also in P. The theorem says that evcrv vector 

(1, 1. 1) + (0. y) 

can also be written in the form 

( 1 , 0 . 0 ) + ( 0 . p'. Y') 

for suitable arid y'- Clearly, P' = 1 f P and y' - I 4 Y- 

To continue the illustration, both ( 1 , 1 , 1 ) and ( 1 , 0 , 0 ) arc in P. The 
difference (0, 1, 1) is obviously in U. Part (b) of the theorem says that 
whenever the difference of two vectors belongs to U, then they both belong 
to the same parallel and conversely. 

3.4.7 Remark Starting from a subspace U, we can obtain many parallels 
of U. This is the same as starling from one straight line through 
the origin and drawing many parallel straight lines through different 
points in the plane. Given a vector v E 1^, we get a parallel v + 

If we take another vector v' E V, the parallel v' + t/ obtained from 
v' will be different from v U iff v ' m not mV -V U. 

Problem Set 3.4 

1. Let Vi, Up ...s Un be n subspaccs of a vector space V, Then prove 

It 

that l/i n n ... n == n £/< is also a subspace of V. 

i = I 

2. If U and W are subspaccs of a vector space V, prove that 

(a) £7 n W' is a subspace of W 

(b) t/ U If' is a subspace ofViffUCWorWC U. 

3. If 5 is a nonempty subset of V, prove that’ [S] is the intersection of all 
subspaces of V containing S. 

4. Prove that the set of vectors (jcj, *3 jr„) € Vn satisfying the follow- 

ing m conditions is a subspace of V„ : 

«U*1 + + ... + «lnA» == 0 

«*I»1 + = 0 

m • • • 

^ml^t "h ®mt^* "i* ••• 4" = 0 , 

«,i's are fixed scalars. 

5. Find the intersection of the given sets U and fV and determine 
whether it is a subspace. 

(a) U - {(xj, X,) € F, 1 xi > 0}, IF - {(Xx. x.) € F* | < 0) 

(b) C7 « {/€ ^(- 2 , 2) l/l-l) « 0}, 
IF-{/e^(-2.2)|/ll)-0} 
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(c) U^{fE<^(-2,2)\MJ{x)^0}, 

jr>l 

W^{f£. Wi-2, 2) I Urn Ax) = 1} 

x*2 

(d) U=^9,W= {/€ t^(-oo. 00 ) \Ax) =A-x)}. 

6. Describe i4 + for the given subsets A and B of Vt and determine in 
each case whether it is a subspace or a parallel or just a subset of Kj. 

(a) A = {(1, 2), (0. 1)}. B = {(1, 0). (3, -1)} 

(b) A = {(1, -2). (5. 1)}. B = {(3, 5), (J, 3), (V2, n)} 

(c) A = {(J, I)}, B — segment joining (1, 1) and (2, 3) 

(d) A = {(2. 3)}. B = {t(3, 4) I 1< t < 2} 

(e) A = {(3. 7)}. B = {(/(-I. 2) I 0 < r < 1} 

(f) ^ = {(J.2)}.5 = {t(3,0)l/>0} 

(g) ^ = {(2. 4)}, B = {ix,y) \ 2x + 3y=l} 

(h) A = {(1. 5)}. B = {(X, y)lx> + y^ = l) 

(i) A = {t(3, 4) I 0 < / < 1}, J = {/(2, 5) 1 1< / < 2} 

(j) 4 = 0(1, 0) I 0 < / < 1}, 2? = 0(0, 1) I 2 < f < 4} 

(k) A = {f(l, 0) 1 r a scalar}, B = [(1, 2)] 

(l) A = line jc = 3r, = 4r, 5 = line 2x + 5y = 0. 

7. Describe .4 + ^ for the given subsets A and B of Determine in 
each case whether i4 + ^ is a subspace or a parallel or just a subset of 
J'a. 

(a) ^ = {(1, 2. 1)}. B = {/(1, 2, 0) I / a scalar) 

(b) A = {(3. 1. -1)}, B={(x,y.z)lx+y + z = 0} 

(c) A = {(1, -3, 4)}. B = [(1, 2. 3), (0, 0, 1)1 

(d) ^ = [(1,2. 3)1, 21= {(3,1.0)] 

(e) A = [(1/2, 2/3, 1)1, B = plane 2 jc + 3>' + z = 0 

(f) A = [(5, 0, 2)1, B = [(1, 2, 3), (0, 1. 2)1 

(g) A = [(1, 0. -1)1, B = 1(2, 5, 8), (2, 3. 4)]. 

8. If U and IV are two subspaces of a vector space V, prove that 
U + IV=:UiAIVC U. 

9. Let A and B be two nonempty finite subsets of a vector space V. Then 
prove that 

(a) [A nB]C [A] n [^1 

(b) [4 U BJ = [4] + [iB]. 

10. Tf Ux, Ut, and I/j are three subspaces of a vector space V, prove that 

(Vx n c^,) + (Vt n c (Ux + if.) n ci,. 

11. (a) Prove that two paralld stnught lines in are parallels of the 

same nontrivial subspace of Kg. 

(b) Prove that the sum of two distinct intersecting lines in Fg is Fg, 
Is it a direct sum 7 



LINEAK DEPENDENCE, INDEPENDENCE / 85 

12. (a) Show that the set of all solutions of the equation 3 jc, + 2xi—x, 
+ •*< = 5 can be expressed as (1, —2, 2, 8) + FP’,Cwhere'»' is 
the space of all solutions of the equation Sx^ + 2jr, — x, + 

Xt — 0. 

-(b) Let IV be the set of all solutions of the equation a^Xi + a,Xj -f 
... -f iXhX„ = p. Then show that IP is a parallel in Fn- Find 
its base space and a leader. 

13. Show ,’that the given set P is a parallel in 0, 2). In each case 
find the base space and a leader. 

(a) P = {/|/'(Jf) = 3x*} 

(b) P = {/|/'(x) = xc-*} 

(c) P = {/iru) = sinx) 

(d) P=r {/|/'(x) = x*-i-2x + 3} 

(e) P--= {/!/(!)- 2). 

14. Let tA = {/ G fl, a) | /is odd}, and 

fV = {/€ % i-a,a) I /is even}. 

Then describe (a) £/ O IP and (b) 17 -I- IP, and determine whether they 
are subspaces of o). Is o) C Cl IP ? Is 17 -i- IP 

a direct sum ? Is o) = 17 © IP ? 

15. Prove that a linear variety is a subspace ijf its leader belongs to the 
base space. 

16. True or false 7 

(a) For any subset A of a vector space P, 

[A] ^-[A + A]. 

00 

(b) If Uf, I = 1, 2, ... are subspaces of P, then f) C/, is a subspace 

1=1 

ofP. ' 

(c) The intersection of two linear varieties is a linear variety, pro- 
vided it is nonempty.- 

(d) The sum of two linear varieties may not be a linear variety. 

(e) The onion of two linear varieties need not be a linear variety. 

fPy 

(f) The set of all solutions of the equation = g, where g 
is a constant, is a linear variety in ^(0, oo). 

(g) In Example 3.14 P« cannot be replaced by Pf> 

3,5 LINEAR DEPENDENCE, INDEPENDENCE 

We start this article with the definition of ‘trivial’ and ‘nontrivial’ 
linear combinations. 
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3.51 DeOaitioa Ifuj, .... u„ arc n vcc\ot% of a vector space V, then 
the linear combination 

»lUi -f »gUa + ... + »nU„ (1) 

is called a trivial linear combination if all the scalars «i, at, .... a« 
are zero. Otherwise the linear combination is said to be nontrivial. 

I 

In other words, a nontrivial linear combination is of the form (1), 
where at least one of the a's is not zero. As illystration, 

4- Omj + ... + 0u„ is a trivial linear combination; 

0«i + Ci/i t- ... + 0«„-i + 1 m» is a nontrivial linear combination; 
and 

Iwi + 2Ui + 3uj 1- ... + nun is also a nontrivial lineai combination. 
Note that the trivial linear combination of any set of vectors is always 
the zero vector, for 

0M| + Ouj 4- ... 4“ 0u„ = 04'0 + ... + 0 = 0. 

The question arises whether a nontrivial linear combination of a set of 
vectors can give the zero vector. The answer is in the affirmative. Consi- 
der the following examples. 

Example 3.20 Let (1, 0, 0), (2, 0, 0), and (0, 0, 1) be three vectors in K,. 
Then we have 

HI. 0. 0) + (- i) (2. 0, 0) + 0(0, 0, 1) = (0, 0, 0) = 0 . 

Thus, a nontrivial linear combination may give the zero vector. 

Example 3.21 Let (1, 0, 0), (0, 1, 0), and (0, 0, 1) be three vectors of V^. 
Take any linear combination of these vectors, say 

«(1. 0. 0) + m 1. 0) + Y(0, 0, 1) , 

which is the same as (a, y). If this were to be the zero vector, then 

(«. Pt y) = (0, 0, 0). Therefore, a — 0 — p = y- 

In this case the only linear combination that gives the zero vector is 
the trivial linear combination. The same is true in the’ following example. 

Example 3.22 Let (1, 1, 1), (1, 1, 0), and (1, 0, 1) be three vectors. As 
before, if 

«(1, 1, 1) + p(l, 1, 0) + Y(l, 0, n = (0, 0, 0) . 
then (a + p + Y» « + P. « + y) = fO, 0, 0) . 

Therefore, a + p + Y = 0, a + p = 0, and a + y = 0. These give a = 
0 = p = Y. 

It is clear that these three examples fall into two categories. Examples 
3.21 and 3.22 are of one kind, whereas Example 3.20 is of another. In 
Example 3.20, (1, 0, 0) is a linear combination of (2, 0, 0) and (0, 0, 1) : 

(1,0,0)= i(2, 0,0) + 0(0, 0,1). 

In other words, (1, 0, Q) depends on (2, 0, 0) and (0, 0, 1). We say that 
these three vectors are linearly dependent. On the other hand, in Examples 
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3.21 and 3.22 there is no such dependence of one vector on the others. We 
say that they are linearly independent. 

We formalise these concepts of linear dependence and linear indepen- 
dence in the following definitions. 

3.5.2 Definition A set {ui, u,, ..., of vectors is said to be linearly 
dependent (ld) if there exists a nontrivial linear combination of 
Wi, Ut > ..., Un that equals the zero vector. 

Example 3.23 Prove that the vectors (1, 0, 1), (1, 1, 0), and (—1, 0, —1) 
are ld. 

To prove linear dependence we must try to find scalars a, y such that 
a(l, 0. 1) -f P(l, 1, 0) -I- 0, -1) = 0 - (0, 0, 0) . 

Therefore, a-HP — and a — y = 0. This can happen iff 

« — Y- Any nonzero value for «, say 1, will do. Thus 

1(1, 0, 1)4 0(1, 1,0)-!- 1(^1,0,-1) = 0. 

So there exists a nontrivial linear combination of the given vectors, which 
equals the zero vector. Hence, the vectors are ld. 

Once we find a nontrivial linear combination equal to the zero vector, 
linear dependence is proved. Very often it is possible to guess such a 
linear combination. 

3.5.3 Definition A set {«t, «„} of vectors is said to be linearly 

independent (li) if no nontrivial linear combination of ut, 

equals the zero vector. 

*No nontrivial linear combination equals the zero vector' means the 
following : 

If at all there is a linear combination that equals the zero vector, then 
it must be the trivial linear combination. Now recall that the trivial 
linear combination is always zero. So the statement within quotation 
marks means ‘The only linear combination that equals the zero vector is 
the trivial linear combination’. In view of this. Definition 3.5.3 can 
be reworded as follows. 

3.5.4 Definition (Reworded) A set {ui, u*, ..., Wn) of vectors is said to 
be linearly independent (li) if the only linear combination of 
Ui, Uj, ..., Un that equals the zero vector is the trivial linear 
combination. 

By convention, the empty set is considered to be u. Note that linear 
dependence and linear independence are opposite concepts. 

Example 3.24 Prove that the vectors (I, 0, 1), (1, 1, 0), and (1, 1, —1) 
are u. 

If possible, let 

*(1, 0, 1) 4 p(l, I, 0) + Y(l, 1, -1) » 0 « (0, 0, 0) . (2) 

This gives « + P + y=’ 0. P + Y®*0, and « — y ** 0. Therefore, « = 0 
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ss'p = y. This means that the only values of a, ft y tAat sstisfy 
Equation (2) are «< == 0 = p = y, i.e. only the trivial linear combination 
equals the zero vector. Hence, the given vectors are u. 

HOW TO CHECK LINEAR DEPENDENCE OR INDEPENDENCE 

The foregoing discussion tells us that when we are given a set 
{U|, Wg, u„) of vectors and we want to check whether it is u> or u, 
the following procedure will be the natural one. 

First, we assume that some linear combination of Uj, u,, u„ is equal 
to the zero vector, that is, 

* 1«1 + «*«8 + — + «nM» = 0 • (3) 

Then two cases arise. One is when it is possible to find scalars aj, ... ixn 
with at least one of them not zero such that Equation (3) is satisfied. In 
this case we conclude that the vectors u,, Ug u„ are ld. 

The other case is when we can prove that our assumption automatically 
implies that = 0 = ag = ... = a». In other words, the only values of a,’s 
that satisfy Equation (3) are = 0 for each i = 1, 2, ..., n. In this case 

we conclude that u^, tq Un are u. 

In the first case, even guesswork in finding the suitable scalars is 
enough, whereas in the second case a proof is necessary. 

Example 3.25 Check whether the following set of vectors is ld or li : 
{(1.0, I). (1, 1,0), (1, -1, 1), (1,2, -3)}. 

Suppose 

«(1. 0, 1) + P(l, 1, 0) + Y(l. -1. 1) + 5(1, 2, -3) = 0 - (0, 0, 0) 
or (« + P + Y + 5, p - y + 26, « + y - 36) = (0, 0, 0) 

or « + P + Y + 6— 0, P— y + 26 = 0, oc + y — 36 = 0. 

This system has a solution « = 56, p = —48, y = —26 for each choice 
of 6. Take6 = l. This gives 

5(1, 0, 1) - 4(1, 1, 0) - 2(1, -1, 1) + 1(1, 2, -3) = (0. 0, 0) . 
Hence, the.given set is ld. 

Example 3.26 Check the linear dependence or linear independence of the 
set {«•, e*"} in ^<“>(-«. «>). 

Suppose that 

+ pc** = 0 (x) 0 for all x € (-oo. <») . 

This gives, on differentiation, 

a.e* -H 2pe*' *» 0 for all x € (“<»• <») . 

Solving these two equations for a and p, we get 

Pe*» 0 for all x € (~oo. <») ; 

but c** is never zero and hence p = 0. It then auto mati cally follows that 
« is ako zero. Thus, the only linear combination that equals the zero 
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vector is the trivial one. Hence, the given set is li in oo, oo). 

We also say that the set is li over (— <»). 

Example 3.27 Check the linear dependence or linear independence of the 
set {X, I jc I } in 1). 

Suppose ajc + P I JC j = 0. 

Since the function | x | is not differentiable at zero, we cannot use 
the method in Example 3.26. 

ax + p 1 X I = 0 holds for all x in (-1, 1). So choosing two diffe- 
rent values of x, say x = 1 /2 and x = —1/2, we get 

= 0 and - + -| = 0. 

Solving these two equations, we get a = 0 = p. Hence, the set is li 
over (—1, 1). 

We shall now take up the geometrical meaning of linear dependence. 
For this we need the following definitions in a vector space V. 

3.5.5 Definition Given' a vector v 0, the set of ail scalar multiples of 
V is called the line through v. 

Geometrically, in the cases of Vi, V^, and Fj it is nothing but the 
straight line through the origin and v. 

3.5.6 Definition T wo vectors Vj and Vg are collinear if one of them lies in 
the ‘line’ through the other. 

Clearly, 0 is collinear with any nonzero vector v. 

3.5.7 Definition Given two vectors Vj and Vj, which are not collinear, 
their span, namely, [vj, v,], is called the plane through Vj and vt. 

Geometrically, in the cases of Vt and F, it is nothing but the plane 
passing through the origin, Vi and Vg. 

3.5.8 Definition Three vectors Vi, v„ and v, are coplanar if one of them 
lies in the ‘plane’ through the other two. 

Clearly, 0 is coplanar with every pair of noncollinear vectors. 

Example 3.28 The vectors v and 2v of a vector space F are collinear, 
because 2v lies in the ‘line’ through v, i.e. 2v is a sc^r multiple of v. In 
particular, sin x and 2 sin x are collinear in 9^(7). 

Example 3 29 The functions sin x and cos x in 7(7) are not collinear, 
because neither of the two lies in the ‘line’ through the other, i.e. one is 
not a scalar multiple of the other. Their span, namely, 

[sin X, cos x] = {a sin X -F p cos x ] a, p any scalars} 
is the plane through the vectors sin x and cos x. 

Example 3.30 The functions sin x, cos x, tan x in JF(7) are obviously not 
coplanar, because none of them lies in the ‘plane’ through the other two. 
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Example 3.31 The functions sin^A-, cos'x, cos lx are coplanar. cos lx lies 
in the plane through sin^x and cos*x, since cos 2x is a linear combination 
of cos‘x and sin*x. 

3.5.9 Theorem Let V be any vector space. Then 

(a) The set {v} is to iff v = 0. 

(b) The set {vj, v,} is LD iff Vj and Vi are collinear, i.e. one of them is a 
scalar multiple of the other. 

(c) The set {v„ Vj, Vj} is ed iff Vj, Vj, and v* are coplanar, i.e. one of 
them is a linear combination of the other two. 

Proof : (a) {v} is ld iff there exists a nonzero scalar « such that 
av = 0. This is possible (Problem S, Problem Set 3.\) iff v = 0. 

(b) Suppose {vj, Vj} is ld. Then there exist scalars a, ^ with at least 
one of them, say a .,4 0, such that arj + pv* = 0. Therefore, Vj 
= (—P/a) Vi, which means is a scalar multiple of v^, i.e. Vi lies in the line 
through Vj. Hence, Vi, are collinear. 

Conversely, if Vi and v, are collinear, then, by definition, one of them, 
say v^, lies in the line through v,. Therefore, Vi is a scalar multiple of v,. 
So v'l = ar*, i.e. 1 • v, — av^ — 0. Hence, r, and Vj arc ld. 

(c) Suppose {V], Vj, Vj} is ld. Then there exist scalars a, p, and y 
with at least one of them, say a # 0, such that 

aVj + pv* + yv, = 0 

or Vi = (-p/a) Vj + (-y/a) Vj . 

This means V| £ [v,, v,]. Hence, Vj lies in the plane thiough and v,. So 
Vj, Vj, and v, are coplanar. 

Conversely, if Vj, Vj, and v, are coplanar, then one of them, say 
Vi € [v*, vJ, i.e. Vj = a,v, + ajV, for suitable scalars a* and a,. Therefore, 
IVj — ajVj — a,Vj = 0. Hence, Vj, v„ and v, are ld. 

As illustration, consider the three vectors (1, 1, 1), (1, —1, 1), and 
(3, — 1, 3). They are ld, for 

1(1, 1, 1) + 2(1, -1, 1) - 1(3, -1, 3) = 0 . 

Hence, by Theorem 3.S.9, the plane through (1, 1, 1) and (3,-1, 3) con- 
tmns the point (1, —1, 1). Let us verify this. 

The plane through (1, 1, 1) and (3, —1, 3) is 
1(1. 1. 1). (3, -1, 3)1 = {(a + 3P, « — p, a + 3P) | a, p any scalars}. 
This set contains (1, —1, 1), for we have only to choose a and p such that 
a + 3p = l, a — P — —1, a + 3P = 1. 

This gives a = —1/2 and p = 1/2. 

Before we proceed, we shall record some simple facts about linear 
dependence. 

3.5.10 Fact In a vector space V any set of vectors containing^ the zero 
vector is ld. 
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For, if {Vj, y,, vj is a set and y, » 0, 
then 

Opi + Ovj + ... + OVi-i + ly| + Oy<+i + ... + Oy, 

is a nontrivial linear combination resulting in the zero vector. 

3.5.11 Fact In a vector space V, if y is a linear combination of 

vi, v„ ..., v„, i.c. y G K, y, v„], then {y, yj, .... v*} is ld. 

For, y G [•’i, v* .... Pb] means 

P = fltjVs + ... + a,y„ , 

i.e. ly — ajVj — ... — «„v„ = 0. 

3.5.12 Fact In a vector space V, if the set {vi, v,, Vn} is Ll and 

V ^ K, y* v„], then the set {v, v„ y*. .... y,} is li. 

The proof is lefi to the reader. 

In the case where the set consists of just two or three vectors, we can 
look at these facts from the ‘geometric' point of view of Theorem 3.5.9. 
For the purpose of understanding, imagine that V = (though this is not 
necessary for the argument). Since 0 lies in the line through y, {0, y} is 
always ld by Theorem 3.5.9 (b). Similarly, 0 always lies in the plane 
through any two vectors Vx, Vg. Hence, {0, Vi, Vj} is always ld by Theorem 
3.5.9 (c). 

The idea contained in Theorem 3.5.9 does not stop with just three 
vectors. We can in fact work out a general result on the same lines for 
a linearly dependent set of n vectors. Before we do that, let os look at the 
theorem once again. Actually, in the proof, we have indicated the 
following : 

(0 {<'i> is LD iff one of the vectors is a scalar multiple of the 
other and (ii) {vi, Vj, Vj} is ld iff one of them is a linear combination of 
the others. 

In general, we shall now prove in Theorem 3.5.14 that if {vi, Vj, ..., Vn} 
is ld, then one of the vectors is a linear combination of the others, the 
converse of which is Fact 3.5.11. Before that, we state the following 
simple theorem and leave its proof to the reader. 

3.5.13 Theorem (a) If a set is Li, then any subset of it is also li, and 
(b) If a set is ld, then any superset of it is also LD. 

3.5.14 Theorem In a vector space V suppose {vi, y*, ...» Vn} is an ordered set 
of vectors with yi vt 0. The set is ld iff one of the vectors 
vi, ys, .... Vn, say y*, belongs to the span of v„ .... yt_i, i.e. y» G [vi, 
V*, .. . vt_i] for some k —2,3 , .... n. 

Proof : Suppose y* G Ivi, v., .... v*_i]. Then y* is a linear combi- 
nation of vi. y*, .... v»-'. Thus, the set {yi, yt» .... ys-i. v*} is LD. Hence, 
by Theorem 3.5.13 (b), {yj, yi, ...» v«} is ld 
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Conversely, suppose that {vj, v*, v,} is ld. Consider the sets 
Si = {v,} 

St — *•) 

Si = {vj, V, vj 

Sn “ K, V„ .... V„} . 

By Theorem 3.5.9 (a), Si is u and by assumption Sn is ld. So we go 
down the list and choose the first linearly dependent set. Let St be that set. 
Then St is ld and is Lt. Here 2 < k <,n. 

Since St is ld, we have 

a,Vi + a,v, + ... + tttVt — 0 , 

with at least one of the a's not zero. Surely ^ 0, for if a-t = 0, then 
S,r-l would become a linearly dependent set contradicting our statement 
that Sx is the first linearly dependent set. Therefore, we can write 

V* = (- ^ ) »'l + (- + — + (- •'*-1 , 

«fc «* 

which means vt G [vj, vs, ..., v^.J. 

3.5.15 Corollary A finite subset S = (vi, Vi, ..., v„} of a vector space V 
containing a nonzero vector has a linearly independent subset A such 
that [A] = [5]. 

Proof : We assume ^0. If 5 is li, then there is nothing to 
prove, as we have A — S. If not, then, by Theorem 3.5.14, we have a 
vector V* such that v* e .... v*_,]. Discard v*. The remaining 
setSi = {vi, ..., v*_i, vjbni •••, rj has the same span as that of S (see 
Problem 4 (c). Problem Set 3.3). If Si is li, then we are done. If not, then 
repeat the foregoing process. This must finally lead to a linearly indepen- 
dent subset A such that [/I] = [S]. (Why ?) 

Example 3.32 Show that the ordered set {(1, 1, 0), (0, 1, 1), (1, 0, —1), 
(1, 1» I)} is LD and locate one of the vectors that belongs to the span of 
the previous ones. 

Consider the sets 

Si = {(1. I, 0)} 

St = {(1, 1. 0), (0, 1, I)} 

= 1.0), (0.1, 1),(1.0,-1)} 

St = {(1, 1, 0). (0, 1, 1), (I. 0, ~1), (1, 1. 1)} , 

Obviously, Si is li. St is also li, because neither of the two vectors in 5, 
is a scalar multiple of the other. 5, is ld, because 

1(1, 1, 0), - 1(0, 1. 1) - 1(1, 0, -1) « (0, 0. 0) . 

Hence, (1, 0, —1) £ [(1, 1, 0), (0, 1, 1)]. S^ is ld, because of Theorem 
3.5.13 (b). 
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Example 3.33 In Example 3.32 find the largest lineariy independent 
subset whose span is [5J. 

As proved in Example 3.32, (1,0, —1) € [(1, 1, 0), (0, 1, 1)] and 
hence {I,'0, —1) € [(1, 1, 0), (0, 1, 1), (1, 1, 1)]. Therefore, we discard 
(I, 0, —1). The span of the remainingset A = {(I, 1, 0), (0, 1, 1), (1, 1, 1)} 
is the same as [iSJ. Now we check for the linear independence of A. 
Suppose 

ail, J, 0) + p(0. 1, 1) + Y(l. 1, 1) = (0. 0, 0) 
or (« + Y. « + P + Y. P + Y) == (0, 0, 0) . 

This means a + Y = 0, a-i-p + Y=®0, ^ + Y = 0. Solving these equa* 
tions, we get only one solution, i.e. a 0 = p = Y- Hence, the set is li. 
Therefore, A = {(1, 1, 0), (0, 1, 1), (1, 1, 1)} is the largest linearly inde- 
pendent subset and [A] = [SJ. 

Finally! let us extend the concept of linear dependence and linear 
independence to infinite sets. 

3.5.16 Definition An infinite subset 5 of a vector space V is said to be 
linearly independent (li) if every finite subset of S is Li. 

S is said to be linearly dependent (ld, if it is not Ll. 

Example 3.34 The subset 

S = {1, X, x\ X*, ...} 

of 9 is LI. 

For, suppose OiX*' + i7,x** + ... + On-**’’ = 0 with kj, k,, ..., kn being 
distinct nonnegative integers. Note that the equality is an algebraic 
identity, since the right-hand side is the zero polynomial. So, either 
by giving various values to x or by repeated differentiation of both 
sides of the identity, we get 

flj = 0 = a* = ... = . 

Problem Set 3.5 

1 . Which of the following subsets S of V 3 are li ? 

(a) S - {(1, 2, 1), (-1, 1, 0), (5. -1, 2)) 

(b) S = {(1,0,0), (1,1.1), (1,2, 3)} 

(c) S = {(I, 1, 2), (-3, 1,0), (1, -1, 1). (1, 2, -3)} 

(d) S = {(1,5, 2), (0,0,1), (I, 1,0)} 

(e) S = {(1/2, 1/3. 1), (0. 0, 0). (2, 3/4, -1/3)}. 

2. Which of the following subsets S of Vt are ld ? 

(a) S = {(I. 0, 0, 0), (1, 1. 0, 0), (1. 1, 1. 1). (0, 0, 1. I)} 

(b) S = {(1, -1, 2, 0). (I, 1, 2, 0). (3, 0, 0, 1), (2,1, -1. 0)} 

(c) S » {(1, 1, 1. 0), (3, 2. 2, 1), (1, 1, 3, -2), (1 , 2, 6, - 5). 

(1.1, 2,1)} 
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(d) S » {(1/2, 2/3, 3/4, 4), (0, 0, 2, 0). (1. 2, 0, 1), (1/2, 2/3, 3/4, 4)} 
(el S = ((1, 2, 3, 0), (-1, 7, 3, 3), (1. -1, 1, -1)}. 

3. Which of the following subsets iS of ^ are Li ? 

(a) S = {AC* — 1, X + 1, jf -- 1} 

(b) S = { I , AC + AC*, AC — AC®, 3 ac} 

(c) S = {AC, AC* — AC, AcM AC*, AC + AC* + AC* + 1/2) 

(d) S = {AC* - 4, AC + 2, AC - 2, .t»/3}. 

4. Which of the following subsets S of '^(0, co) are li ? 

(a) S = {AC, sin ac, cos ac> 

(b) S = {sin* AC, cos 2 ac, 1} 

(c) S = {sin AC, cos ac, sin (ac + I )} 

(d) 5 = (In AC, In ac*. In ac*} 

(e) S = {ac*<’*, Ace*, (ac® + ac — l)e*}. 

5. Prove that the vectors (a, b), {c, d) are ld iff ad = be. 

6. Prove that 

(a) 1 and i are ld in the set C of complex numbers considered as 
a complex vector space 

(b) 1 and i are li in the set C of complex numbers considered as a 
real vector space. 

7. Show that the set S — (sin ac, sin 2 ac , sin nx) is a linearly indepen* 
dent subset of [—re, n] for every positive integer n. 

8. Prove Theorem 3.5.13. 

9. In the proof of Corollary 3.5.15 answer the question ‘why’. 

10. If u, V, and w are three linearly independent vectors of a vector space 
y, then prove that « + v, v + w, and w + u are also li, 

1 1 . Find a linearly independent subset .4 of 5 in Problem 1 such that [A] 

= [S]. 

1 2. Proceed as in Problem 1 1 for the sets S in Problem 2. 

1 3. Proceed as in Problem 1 1 for the sets S in Problem 3. 

1^ Proceed as in Problem 1 1 for the sets S in Problem 4. 

15. In Problems 1, 2, 3, and 4, whenever a set is ld, locate one of the 

vectors that is in the span of the others. 

16. True or false ? 

(a) (sin AC, cos ac, 1} is ld in ^ (0, 1). 

(b) {i +j.i -121+ 3j} is LD in K,. 

(c) ' If u„ Ut, Ua are ld, then 

— 0 ^ one of the a's is not zero. 

(d) Every set of three vectors in F, is ld, 

(e) A set of two vectors in Vt is always li. 

(f) If a vector v is a linear combination of Wj, u.. »«, then 

{«i. «s. •— «n) is LI, 
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(g) A subset of a linearly dependent set can never be ld. 

(b) Every superset of a linearly independent set is u. 

(i) X and | jc | are u in ^[1. 4]. 

3.6 DIMENSION AND BASIS 

We shall begin this article with the definition of a ‘basis'. 

3 6.1 Definition A subset B cf a. vector space V is said to be a basis for 
Kif 

(a) B is linearly independent, and 

(b) [5] = V, i.e. B generates V. 

Another definition of a basis, which is used by some authors, will be 
introduced as an equivalent property in Theorem 3.6.8. 

Example 3.35 Take V = Consider the set B = {i, j. A}, where 
/ = (l,0,0,/ = (0, 1,0), A -(0,0, 1). 

The set B is Li, b^ause 

*i + ft; + yJfc = *(1, 0, 0) + ft(0, 1,0) + y( 0. 0, 1) = 0 = (0, 0, 0) 
implies that (a, ft, y) = (0, 0, 0), i.e. a = 0 = ft — y. Also B spans V,, 
because any vector (x„ Xg, x,) of K, can be written as a linear combination 
of /, j, and A, namely, (.Vi, Xg, x,) = Xif + xj + XjA. Hence, is a basis 
for Kg. 

It may be seen that the set ~ {(I, 1, 0), (1, 0, 1), (0, 1, 1)} is also a 
basis for Kg, because any vector (x„ Xg, Xg) £ can be written as 

(Xi, Xg. xg) = (I, 1,0) + 3 .. + *3 T ^^ (1.0, 1) 

+ + (0.1.1) 

and a(l, 1, 0) f P(l. 0, 1) f y(0, I, 1) = (0, 0, 0) 

implies a = 0 = ft = y, i.e. B is Li. 

This example shows that a basis for a vector space K need not be 
unique. 

The two properties Of a basis B, namely, (i) B is u and (ii) B gene- 
rates y are not entirely unrelated especially when B is finite. For, if a set 
B of n elements generates V, then we can prove, with some effort, that no 
linearly independent set can have more than n vectors. This result js the 
content of the following important theorem. 

3,6.2 Theorem In a vector space V if {vg, v, v,} generates V and if 

{Wg, w„ .... is u, then m < n. 

In other words, we cannot have more linearly independent vectors than 
the numbm of elements in a set of generators. 
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Proof: Let us adopt the following notations. If S is a finite linearly 
dq>endent ordered set of vectors i/i, M|, ... «* with «j 0, then 

(i) by Theorem 3.5.14, there is a vector u„ 2 <i<p, which is a linear 
combination of its predecessors. Let S' denote the ordered set which 
remains after the deletion of such a U{ and 

(ii) for every vector w, let wS denote the ordered set {w, Wi, «*, .... Vp). 

Now construct the set 

■Si = {w*. Vi, v„ .... . 

Si has the following properties : 

(0 I'Sil =■ V, because {vj, «„} spans V and Wm G V, 

(ii) Si is LD, since w„ €. V = [vi, v, v„], and 

(iii) w„ ■¥- 0. 

So, applying Theorem 3.5.14, we see that S'l can be formed by deleting 
vector V(, which is a linear combination of w„, Vi, v^, , v,_i. 

Now consider the set S, = k’„_i S^. Since spans V, 5* also does so. 
Further, S* is ld, since £ F = and ^ 0. Therefore, by 
another application of Theorem 3.5.14, we form Sj. Then we construct 
the set Sp = and continue the process of constructing new sets S 

and S'. Since the set of w's is u, every time the discarded element must 

bea V. 

If all the w's are used up in this process, then m<n. Otherwise the 
set {Wm-n, Wm.a+i, ..., w„_i, Wm} would bc LD, which contradicts the linear 
independence of the tv’s. | 

3.6.3 Corollary IfV has a basis of n elements, then every set of p veclois 
with p > n, is ld. 

Proof : Suppose B = {vj, v*, ..., v„} is a basis for V. Let A 
= {«i. M*i . •» Wp) a set of p vectors, p> n. If ^4 is Li, then p < n by 
Theorem 3.6 2. Hence, A is ld. | 

3.6.4 Corollary If V has a basis of n elements, then every other ba^is for V 
also has n elements. 

Proof : Suppose Bi = {v„ v„ . ., v„} and 5, = {wi, w are 

two bases for V. Then B, and B, are li and [fi,] = V, [S,] = V. 

Since [BJ = V and B, is li we have, by Theorem 3.6.2, m < n. Since 
[B^ — V and Bi is Li we get, by the same theorem, n < m. Thus, m » n. B 
The number of elements in a basis is therefore unique and hence the 
following definitions. 

3 6.5 Deflnlthni If a vector space V has a basis consisting of a finite 
number of elements, the space is said to be finite- dimensional; the 
number of elements in a basis is called the dimension of the space and 
is written as dim V. If dim F = n, F is said to be n-dimensional. If 
V is not fintte^imeqsional, it is called infinitetUmendonal. 
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If K = Pj = {0}, its dimension is taken to be zero. 

3 . 6.6 Remark It follows from Corollary 3.6.4 that, if a vector space V 
is H'dimensional, (a) there exist n linearly independent vectors ip V 
and (b) every set of n + 1 vectors in V is ld. 

Example 3.36 is 2-dimensional, because (1, 0) and (0, 1) form a basis 
for Vf Vg is 3-dimcnsionaI, because Kj has a basis of 3 elements, namely, 
1 , 7 , and k. 

Vn is n-dimensional, for, consider the elements 
= ( 1 , 0 , 0 , ..., 0 ) 
e* = ( 0 , 1 , 0 0 ) 

- (b, 0 , 0 , .... 1 ) 

with Ci as the vector, all of whose coordinates are zero except the / -ih, 
which is I. It is easy to see that Cj, Cj, , e„ are u and every «-tuplc is 
a linear combination of e*, ..., e„. 

Thus, the set {Cj,, e .^, ... , e„} is a basis for V„. The basis {Ci, e*, ..., e„} 
is called the standard basis for and will be used in the sequel without 
any further mention. In particular, note that { 1 , 7 , fc} is the standard basis 
for K 3 . fn other words, 

e. = (1,0,0) = I 

Cj = ( 0 , 1 , 0 ) = 7 * 

t-, ( 0 , 0 , 1 ) = * 

Example 3.37 Find the dimension of the space 

Every polynomial in d'n is a linear combination of the functions 
1, X, X*, ..., -x". Further, this set is Li. (Why ?) Hence dim = n -f 1- 

3.6.7 Theorem In an n-dimensional vector space V, any set of n linearly 
independent vectors is a basi^. 

Proof : Suppose B = (I’l, Vj, ..., v„} is a set of n linearly indepen- 
dent vectors. To prove that J? is a basis we have only to show that B 
spans V. 

Take V &V. The set {vj, v*, ..., v„, v} is ld, because V is n-dimen- 
sional (cf Remark 3 . 6 . 6 ). Hence, by Theorem 3.S.14, one of the vectors 

V 2 , V 3 Vn, say V, is in the span of all its predecessors. Obviously, this 

one cannot be'any one of Vj, V 3 , ..., v„, for in that case we shall be contra- 
dicting the linear independence of (vj, Vj, ..., Vn}. Hence, v C {vi, Vj, .... v,]. 
Therefore, B spans V. | v 

Example 3.38 Prove that the set 1(1, 1, 1), (1, —1, 1), (0, 1, 1)} is a basis 
for V,. 

To prove this we have to prove only that the set is li, because is 3- 
dimensional. Suppose 
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«(i. 1. 1) + P(i, -I. 0 + yCO. J» 0 “ 

or (a + p, « — P + Y» * + P + y) “ • 

Soa + p=o, a — p + Y = 0, a + p + Y = 0- These equations give 
ot = 0 = p = Y- Hence, the set is u and is therefore a basis for F,. 

We shall now take up the theorem referred to immediately after Defi- 
nition J.6.1. This theorem gives rise to the definition of a basis used by 
some authors (see Remark 3.6.9). 

3.6.8 Theorem '/« a vector space V let B •= {v^, Vj, ..., v„} span V. Then 
the following two conditions ate equivalent : 

(a) {r,, Vjj, ..., v„} is a linearly independent set. 

(b) If V G V, then the expression v — «iV, -f + ... + «nV» is 
unique. 

Proof : .Assume (a). We shall prove that any expression for v in 


terms of Vj, Vj, 

..., v„ is unique. For, 

if 





V = a,v, + ajVj 

+ .. 

.. + 

anVn 

( 1 ) 

and also 







V = PiVji + PaVg 

+ .. 

.. f 

PnVn s 

( 2 ) 

then ajVj 

+ + ... + a„v, = 

= Pi>'i + 

+ ••• + Pn^n 



or (ai - Pj)vi -h («2 - pj)v, + . . + (a„ - p„)v„ = 0 . 

But the v,’s are Li, so a, — p^ = 0 for all i. This gives «, = P, for all i and 
hence expression 1 1 ) is unique. 

Conversely, assume (b). Suppose now that the v,'s are not n, i.e they 
are ld. Then there exists a nontrivial linear combination, say 

PlVi + PtV* + ... + PnV« , (3) 

which equals the zero vector. But 0, on the other hand, is already equal 
to the trivial linear combination 

Ov, + Or, + ... + 0v„ . (4) 

Thus, we get two different expressions, (3) and (4), for 0. This contradicts 
(b). Hence, K, v^, ..., v„} is u. | 

3.6.9 Remark Note that the foregoing proof can be adopted for infinite- 
dimensional cases also. 

Further, note that a basis B has two properties : 

(i) B is LI and 

(ii) ‘ [B] = V. 

Hence, the following conclusion is obtained : *A set R is a basis for a 
vector space V iff [B]=^ V and the expression for any v € K in terms 
of elements of B is unique/ 

We now define the term coordinate vectw. 
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3.6.10 Definition Let B — {wj, v,. .... v„} be an ordered basis for V. Then 

a vector v £ K can be written as v = + «,v, + ... + a,v,. The 

vector (a„ a„ , a„) is called the coordinate rector of v relative to the 
ordered basis B. It is denoted by [v]ji. a„ a,, .... are called 
the coordinates of vector v relative to the ordered basis B. 

The coordinates of a vector relative to the standard basis are simply 
called the coordinates of the vector. 

It should be noted that [v]^ is unambiguously fixed in view of Remark 
3.6.9. 

Example 3.39 Find the coordinate vector of the vector (2, 3, 4, —1) of 
Vt relative to the standard basis for 

The standard basis for is {«„ Ct, ^ 4 ), where Ci = (1, 0 , 0, 0), 
e* = ( 0 , 1 , 0 , 0 ;, €3 — ( 0 , 0 , 1 , 0 ), and Ct — ( 0 , 0 , 0 , 1 ). Obviously, 
(2, 3, 4, — 1 ) = 2ei + 3fa + Ae^ — le^. So the coordinate vector of 
( 2 , 3,4, — 1 ) relative to the standard basis is (2, 3,4, — 1 ). Therefore, 
2, 3, 4, and —1 are the coordinates of the vector (2, 3, 4, —1). 

If the reader finds that this example is not very illuminating, he should 
study the following example. 

Example 3.40 Find the coordinates of (2, 3, 4, — 1) relative to the 
ordered basis B ((1, 1, 0 , 0 ), ( 0 , 1 , l, 0 ), (o, 0 , 1 , i), (i, 0 , 0 , o)} for v^. 
(The reader can verify for himself that R is a basis for V^.) To get the 
coordinates of (2, 3, 4, —1) relative to B, we write 

(2, 3, 4, -1) = a(l, 1 , 0, 0) + p(0, 1, 1, 0) + t( 0, 0, I, 1) + 8(1, 0,0,0) 
or (2, 3, 4, — 1) = (a + 6 , a + p, p + Y, y) . 

This gives a + 8 = 2, a + P = 3, P + y = 4, y = -1. Solving these 
equations, we get « = — 2, p = 5, y = ~1» 6 = 4. Hence, the co- 

ordinates of (2, 3, 4, —I) relative to the ordered basis B are —2, 5,-1, 
and 4. (-2. 5 , - 1 , 4) = [(2, 3, 4, ^ l)]j,. 

We now prove a theorem on the extension of a linearly independent set 
to a basis for a vector space V. 

3.6.11 Theorem Let the set (v^, v*, ..., v»} be a linearly independent subset 
of an n-dimensional vector space V. Then we can find vectors 
v»+i, .... v« in V such that the set {vj, •• , v*, Vj+i, .... v,J is a basis 
forV. 

Proof: By Theorem 3.6.2, k<n. If k = n, then, by Theorem 

3.6.7, (Vj, v„ is a basis for V. l( k < n, then K, v, .y,} » 

not a basis for V (Corollary 3.6.4). But the set K, v„ ..., y*) is Li. 

Therefore. [»„ vj # V. Hence, K, v„ , vj is a proper subset of 

V. Thus, thme exists any nonzero vector yjH-i in V such that fi; 
1 ^ 1 , vj. 
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Hence, the set {vi, v*, v*n} is Li; otherwise, by Theorem 3.5.14, 
one of the vectors v„ Vj, ...» v*, say Vi+„ is in the span of all its 
predecessors. 

Now, if ifc + 1 = «, we are done. If not, we repeat the foregoing 
process until we get n linearly independent vectors {vj, Vj, Vi, 
Vt+i. •• » Vb}. This forms a basis for V by Theorem 3.6.7. Q 

3.6.12 Remark We can produce any number of bases, because we can 
start from any nonzero vector and extend it. 

Example 3.41 Given two linearly independent vectors (1, 0, 1, 0) and 
( 0 , — 1 , 1 , 0 ) of K 4 , find a basis for K 4 that includes these two vectors. 
[(1, 0, 1, 0), (0, -1, 1, 0)] = {(a, -p, a + P, 0) 1 a, P any scalars}. 

As in Theorem 3.6. 1 1, so too now we choose a vector outside this span 
and get an enlarged linearly independent set. 

Since the fourth coordinate is always zero for vectors in this span, 
certainly (0, 0, 0, 1) is not in this span. Thus, we get an enlarged linearly 
independent set {(1,0, I, 0), (0, —1, 1, 0), (0, 0, 0, 1 )}, whose span is 
[( 1 , 0 , 1 , 0 ), ( 0 , - 1 . 1 . 0 ), ( 0 , 0 , 0 , 1 )] - {(«, - p, « + p, y) 1 «, p. Y are 
scalars}. Now we have to identify one element outside this span. Given 
a. Y> the third coordinate in the elements of this span is always a h- p. 
So we shall look for a vector for which this is not true. Clearly, 
(1, —2, 0, 0) is not in the span of the earlier set. So we have a set 

R = {( 1 , 0 , 1 , 0 ), ( 0 , - 1 , 1 , 0 ), ( 0 , 0 , 0 , 1 ), ( 1 , - 2 , 0 , 0 )} . 
which is u and, by Theorem 3.6.7, it is a basis for V^. The reader is 
advised to verify that this is indeed a basis. 

Example 3.42 Let {(1, 1, 1, l),(l, 2, 1, 2)} bealinearly independent subset 
of the vector space V^. Extend it to a basis for V^. 

We have 

[(I, i;.l, I.). (1. 2 . 1 . 2 )] = {(a + p, a + 2 p. « + p. 

a + 2 p) 1 a, p are scalars} . 

Since the first and third coordinates are equal for all vectors in the span, 
we find that ( 0 , 3, 2, 3) is not in the span. Thus, we have an enlarged 
linearly independent set {(1, 1, 1, I), (1, 2, 1, 2), (0, 3, 2, 3)}, whose span is 

[( 1 , 1 , 1 , 1), ( 1 , 2 , 1 , 2 ), ( 0 , 3, 2, 3)1 = {(a + p, « + 2P + 3y, a + P + 2 y. 

« + 2P + 3y I «, P, V are scalars) . 
Obviously, the vector (2, 6 , 4, 5) is not in this span. Hence, the set 
{( 1 , 1 , 1, 1), (1, 2 , 1, 2), ( 0 , 3, 2, 3), (2, 6, 4, 5)} is u. Thus, by Theorem 
3.6.7, it Is a basis for F 47 

We shall now prove two theorems on dimensions of subspaces. 

3.d.l3 Theorem Let U be a subspaee of a finite-^imensioml vector space V. 
Thai dim U < dim V. ^pudity holds only when V 
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Proof’. Let £ — {vj, Vj, v„} be a basis for V. This generates V 
an has n elements. ^ Any set of linearly independent vectors in V and 
t erefore any set of linearly independent vectors in U cannot have more 
than n vectors. Therefore, dim U < dim V. 

When dim U = dim V, a basis for V, is a set of n linearly indepen- 
dent vectors of V, whose dimension is also n. So, by Theorem 3.6.5, it 
follows that is a basis for V. This means V = [BJ = CA. J 

3 . 6.14 Theorem If U and JV are two subspaces of a finite-dimensional 
vector space V, then 

dim (17 4- IF) = dim U - 1 - dim W - dim (1/ n ■ 

Proof : Let dim U — m, dim W = p, dim (V H l^) = r, and dim 
V ~ n. By Theorem 3 6.13, m < «, p < n, r < n. Lei {vi, v^, .. , »v} be 
a basis for U Ci fV. This is a linearly independent set in U C\ W and 
therefore in U as well as in W So it can be extended to a basis for U, say 

and to a basis for W, say 

t'*! •• > •'r, n'r+i, ..., Wj) . (6^ 

We shall now prove that the set 

^ ’'n «r+i. «m, H-rfi H’,} (7) 

is a basis for U W. In fact, this will complete the proof of the theorem, 
because in that case, the dimension of U W will be the number of 
elements in A, i.e. r -f (m — r) + (p — r) = m -f p — r. This is what the 
theorem asserts. 

To prove that A is a basis for U f IF, we have to prove that (a) A is 
Li iaU + W and (b) [A] = U W. To prove (a) let us assume that 

r m p 

1 a,v, + 2 p,M, + S = 0 . ( 8 ) 

t-l i-r +1 i-r +1 

This gives 

2 a,v< 4-2 p,«, == - 2 (9) 

/-I /=r41 t-r+l 

= V, say. 

The vector v is in U, because the left-hand side of Equation (9) is in V. v 
is also in W, since the right-hand side of Equation (9) is in W. Thus, 
vG,U C\W. Therefore, v can be expressed uniquely in terms of 
Vi, v„ ..., V,. Thus, 

V » 2 ( 10 ) 

I=I 

for suitable 6 ’s. Hence, 

21 64 V 1 4* S 

1-1 i-r+l 


ftWi =» 0 . 


( 11 ) 
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But {Ki, V,, v„ M',+ 1 , Wp} is LI. So each of the S,’s and Yt’s is ^^cro. 
Substituting Yr^fj = yh-* = — y» = 0 in Equation (9), we find that 

r m 

2 a,v, + S p.M. = 0 . (12) 

Is] i=r+l 

Again, {v^, ..., v„ mh-i> •••! Um} is li. So each of the a,'s and P/s is zero. 
Thus, Equation (8) implies that each scalar involved is zero. Hence, A Is 
LI, which proves (a). 

To prove (b), let z £ + Pf'. Then z == u -|- w, where « £ £/ and 

w £ IF. This gives 

z = S «,v, + 2 p.M. + £ a.',v, 4- 2 Pjw, (13) 

/=! »^r|-l /=! /=r+l 

for suitable scalars a.’s, p,’s, a^’s, p<’s. Simplifying expression (13), we see 
that z £ [A], Hence, U W C[A] The reverse in equality is obvious, 
because ACU + 

3.6.15 Corollary JfU and W are subspaces of a finite-dimensional vector 
space V such that U D ~ {0}, then 

dim (U ® W) = dim U + dim W . 

The proof is obvious and is left to the reader. 

As illustration, take U =• the xy-plane and W — the j’z-plane in K,. 
Clearly, U and fV are subspaces of F, and dim V — 2, dim W = 2. 
U nW — y-axis, whose dimension is 1. By Theorem 3.6.14, we have 
dim (£/ + IF) = dim + dim IF - dim (£/ n IF) . 

But U + fV,ia this case, is V^. So 

dim F, = (xy'plane) + dim (yz-plane) — dim (y-axis) 
or 3 = 2 + 2 - 1 . 

This verifies the result of Theorem 3.6.14. 

On the other hand, if we take U = xy*plane and IF = z-axis, then 
n IF = {0} and 1/ + IF = F,. Also, 

dim F, == dim (If ® IF) = dim tf + dim , 
or 3 = 2 + 1. 

This verifies the result of Corollary 3.6.15. 

Now we give a comprehensive example which illustrates different ideas 
studied in this chapter. 

Example 3,43 Take F = the space of all real polynomials of degree at 
most 3. Let Cf be the subspace of consisting of those polyno mials of £?• 
that vanish at x = 1. Let IF be the subspace of 9% consisting of those 
polynmnials of 9% whose first derivatives vanish at x = 1. Study the sub* 
spaces U,W,U a IV,U + Win terms of dimension, basis, and the exten* 
lion of each of these toses to a basis for V 
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Let p Stand for an arbitrary polynomial. Recall that K stands for the 
set of real numbers. Then 

y sa {p \ degree of p < 3} 

= {« + PAf + I a, P, y, 8 G R) . 

We know that dim V — 4. Also 
= {pG Flp(I) = 0} 

— {« + Px + YX* + 8 jc* 1 a + p + Y + 8 = 0; 

«, P. Y. 8 G R) 

= {(— P — Y - 8) + p.T + Y*® + 8x* 1 P, Y. 8 G R} 

= mx _ 1) + y(a* - 1) + 5(x» - 1 ) 1 P. Y, 8 G R} . 

This shows that the set [x — 1, x* — 1, — 1} spans U. Since it is 

easily seen that this set is u, it also forms a basis for V. So dim U — 3. 

This basis can be extended to a basis for K — by taking another 
element that is not in the span V of these polynomials. Such a polynomial 
is a constant polynomial, say 1. Thus, by Theorem 3.6.7, {l,x— 1, 
X* — 1 , X* — 1} is a basis for V — Again, 

w = {pev\p\\) = Q) 

= {a + Px + YX* + 8x* I P + 2 y + 36 = 0;a,p,Y.8 G R} 

-■= {a + y(x^ - 2x) + 8(.x» - 3x) | a, y. 8 G R} . 

This shows that W is spanned by {1, x* — 2x, x* — 3x}. Since this can be 
shown to be Li, it follows that {1, x* — 2x, x* — 3x} is a basis for W and 
dim W =3. 

The extension of this basis to a basis for <?, is got by looking for just 
one vector that is not in fV. Such a vector is a polynomial x. Thus, 
{1, X, X* — 2x, X® — 3x} is a basis for Again, 

1/ n fV = {p€ SPal P(i) = 0,p'(l) = 0} 

= {a + Px + YJC® + 8x» 1 a + p + Y + 6 = 0, 

p + 2 y + 38 = 0; a, p, Y. 8 G R) 
= {y(1 - 2x + X*) + 8(2 - 3x + x») I y, 8 G R} . 

Clearly, 1 — 2x + x* and 2 — 3x + x* are u. So dim 17 O *= 2 and 
{1 — 2 x + X*, 2 — 3x + X*} is a basis for U D ff'- Now we look for 
elements that are not in 17 O 1^. One such element is x®. Now consider 
the span of the linearly independent set {1 — 2x + x®, 2 — 3x + x®, x*}. 
The span of this set is still not y, because dim F == 4. So look for one 
more element outside this span. One such element is x*. (Why ? Can 
you find others 7) Hence, 

{1 — 2x + X*, 2 — 3x + X®, X®, X®} 

is a basis for V. Finally, 

- Mx ~ I) + - 0 + «.(x» - 1) + Pi 

+ Psfx* 2x) + P»(x® 3x) I ai, «|, «,, Pj, Pt, Pt € R) . 
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So A {(* — 1), (x* — 1), (x* — 1), 1, (x* — 2x), (*• ~ 3x)} spans the 
space U + W. But 

dim (t^ + IF) = dim U + dim W- dim (U D HO 
= 3 + 3-2 = 4. 

Therefore, B is ld. Applying Theorem 3.5.9 to the ordered set C 
= {1, X — 1, x’ — 1, X* — 2.V, X* — 1, X® — 3x}, which is ld, we find 
that X® — 2x e [1, X — 1, X* — 1], for 

x» - 2x == l(x® - 1) - 2(x - 1) - 1(1) . 

Hence, x* — 2x can be discarded. We are thus left with the set 
C = (1, X — 1, x‘ — 1, X* — 1, X* — 3x} , 
which has 5 elements. This is still ld (since dim (C/ + W) = 4). Again, 
by Theorem 3.5.9, there exists a vector that is a linear combination of all 
its predecessors. It cannot be 1 or x — 1 or x® — 1 or x® — 1, since these 
four are Li among themselves. So let us check whether .v® — 3x is a 
linear combination of its predecessors. We have 

X® - 3x = l(.x® - 1) + 0(x® - n - 3(x - 1) - 2(1) . 

Hence, x* — 3x G [1, x — l,x’ — 1, x* — 11 So x® — 3.v can be dis- 
carded. We arc thus left with the set 

D {I, X - 1, X® - 1, .V® - 1) , 

which is obviously a basis for U + tt'. Since dim {U + W) — dim K = 4, 
we get C/ + IF - F, by Theorem 3.6.13. 

Problem Set 3.6 

1. Which of the following subsets S form a basis for F3 ? In case 5 is 
not a basis for Fj, determine a basis for [5]. 

(a) 5= {(1,2, 3), (3, 1,0), (-2, 1,3)} 

(b) S={(1, 1, I),(l,2,3),(-1,0, 1)} 

(c) S = {(0, 0, 1), (1, 0, DJI, -1, 1), (3, 0, D) 

(d) S = 1(1, 2/5, -1), (0, 1, 2), (3/4, -1, 1)} 

(e) S = {(-1, 3/2. 2), (3. 2/3, 3)}. 

2. Which of the following subsets S form a basis for the given vector 
space F ? 

(a) S = {(1, -1. 0, 1), (0. 0, 0, 1), (2,-1. 0. 1), (3, 2. 1, 0)}, 
F=F4 

(b) S = {(0. 1, 2. 1). (1, 2, -1, 1), (2. -3, 1. 0). (4. -2. -7.-5)}, 
F=F. 

(c) 5 = (x — I, X* + X — 1, X* - X + 1), F = 9>, 

(d) S = {1, X, (x - l)x, x(x - 1) (x - 2)}, F = £?, 

(e) S = {1, X, (3x* - l)/2, (5x*-3x)/2, (35x® - 30x* + 3)/8}, 

(f) S = (1, X - 2, (X - 2)*, (X - 2)®}, F = 
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(g) S =s (1, sin X, sin* x, cos* x), V = ^l— 

(h) S = {(I, i, 1 + 0, ( 1 , i, 1 - 0. (/. -»■. D). y = VI 

3. Determine the dimension of the subspace [5] of V, for each S in 
Problem 1. 

4 Determine the dimension of the subspace [S] of V for each S in 
Problem 2. 

5. Extend the set {(3, —1, 2)} to two different bases for K,. 

6. Given 5, = {(I. 2, 3), (0, 1, 2), (3, 2, 1)} and S, = {(I, -2, 3), 

(—1, 1, —2), (I, —3, 4)}, determine the dimension and a basis for 

(a) [Sjn[S*l (b) [5,] + ISd. 

7. Given 5 as a finite subset of a vector space V, prove that 

(a) If S is LI and every proper superset of 5 in F is ld, then 5 is a 
basis for V. 


8 . 


9, 


(b) If S spans V and no proper subset of 5 spans V, then S is a 
basis for V. 


Find a basis for a subspace 1/ of F in the following ca.<ies : 

(a) C/ = fpG =0}.F= 

(b) U ^ {p £9, \ Pix^) - = 0}, F =: 

(c) U = {(x„ x„) G Vn 1 «iXj+ ... -1- «„.Y„ = 0; «i, 

are any n scalars}, F = F, 


(d) 


U {(X|, ^2, X3, Y4, Xj) C 


V, 


Jfi 4- Xj -f Xj = 0| 

3 xi - X4 + T.Vg = 0' 


v=y. 


(e) £/ = {p G ,9* I p(Xo) = 0}. F = ‘/■g. 




Let U and W be two distinct {n — l)-dimensionai subspaces of an 
/i-dimensional vector space V. Then prove that dim (C/ n fV) 
= w - 2. 


10. (a) Prove that every I-dimensional subspace of F, is a straight line 

through the origin. 

(b) Prove that every 2-dimensional subspacc of F, is a plane 
through the origin. 

(c) Deduce that the intersection of two distinct planes through the 
origin is a straight line through the origin. 

11. Let V| « atCit — ciitfi, / 1, 2, ...» n, and for a fixed A;(< n), be n 

vectors of F, with »» ^ 0. Then prove that Vi, v„ ..., vj_i, vn-i, 

V., is a basis for V of Problem 8(c). 

12. Find the coordinates of the following vectors of F, relative to the' 
ordered basis B = {(2. 1, 0), (2. I, 1). (2, 2, 1)} : 

(a) (1,2,1) (b) (-1.3,1) (c) (X 2 ,x„x,) 

(d) (-V2,«.e) (e) (-1/2,11/3.5) (0 (2. 0,-1). 
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13. Find the coordinates of the following polynomials relative to the 
ordered basis {1 — x, 1 + x, 1 — of 9 % ; 

(a) 3 + 7jt + 2x* (b) X- 3x* {c) x* + 2x - 1. 

14. Find an ordered basis for F4 relative to which the vector 
(—1, 3, 2, 1) has the coordinates 4, 1, —2, and 7. 

15. Let Bi = {vj, Vj, ..., v„} and ^2 = {«i, u„ ..., «„} be two ordered 
bases for an n-dimensional vector space V and let 

«1 = + «*!>’* + ••• + «nlV» 

tt, = «i2Vi + «„V, + ... + «ntV, 

— *lnVi + + ... + «nnVn. 

Then find the coordinates of a vector v £ V relative to the basis 

if its coordinates relative to the basis B, are 

16. Find the dimension of 

17. Construct two subspaces A and B of V^ such that dim A — 2, 
dim B — 3, and dim A r\ B — I. 

18. Let Bi = {«!, Uj, «„} and B^ — {vj, v„} be ordered bases 

for an n-dimensional vector space V such that {ui — «* — v^, .. , 

Un — v„} is LD. Then prove that there exists a nonzero vector u£ V 
such that [u]«|= 

19. True or false ? 

(a) Every vector space has a finite basis. 

(b) A basis can never include the zero vector. 

(c) If two bases of V have one common vector, then the two bases 
are the same. 

(d) If every set of p vectors of V with p > n is ld, then V has a 
set of n generators. 

(e) A basis for V 3 can be extended to a basis for F4. 

(f) A basis for F, is {*'+/ + k, i + j, i). 

A basis for is { 1 , 2x, (x — 1)*}. 

(h) A set of generators of 93 is 

{(x-l)»,(x-l)*,(x-n,x*-l,l}. 

(i) [v]b is independent of B. 

(j) {(!> 0), (0, 1, 0), (0, 0, 1)} is a basis for the complex vector 

space 

(k) In Fj, if (2, 3) is the coordinate vector of (2, 3) relative to the 
ordered basis B, then B is the standard basis, 



Chapter 4 


Linear T ransformations 


The significance of vector spaces arises from the fact that wc can pass 
from one vector space to another by means of functions that possess 
a certain property called linearity. These functions are called linear 
transformations. 

4.1 DEFINITION AND EXAMPLES 

4.1.1 Definition Suppose U and K arc vector spaces cither both real or 
both complex. Then the map T:U ^ Vis said to be a linear map 
(transfoi malion, operator), if 

T{ui + «,) = T(ui) + T(Ui) for all «„ h* G (1) 

and T(pu) =- aTfn) for all u E U, and all scalars a. (2; 

A linear map T:U-^U is also called a linear map on U. Whenever 

wc say 7 : I' is a linear map, then U and V shall be taken as vector 

spaces over the same field of scalars. 

4.1.2 Remark In Definition 4,1,1 the ‘plus’ in Ut + denotes the addi- 
tion in space U, and the ‘plus’ in T(ui) + 7(«j) denotes the addition 
in space V. We shall not elaborate these delicate points in the sequel. 
A similar remark is true for the two scalar multiplications implied 
in Equation (2). 

Example 4.1 Define 7 : K, K, by the rule 
JXxi, Xt, xj = (Xi, x„ 0) . 

It is called the projection of K, on the XjXrplane. To prove that it is a 
linear map, we have to show that 

7(x + y)^ T(x) + 7(y) and T{<tx) - «7(x) 
for all X, y € f', and all scalars «. Let x =« (x^, x„ x,) and y = (y^, y^). 

Then 

jc + y » (xi -f 7i, X, -I- 7,, X, + 7s) 

and «Jc * «x,) . 
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Now, by definition of T, we have 

T{x + y) = r(xj +>'i, X, + Jf, + y,) 

= (xi + yx, X, + 0) . 

On the other hand, 

T{x) + Tiy) = T(xx, xt, x,) + 7Xy„ y^, yt) 

= (x„ x,, 0) + (>’„ y^, 0) (definition of T) 

= (xi + yi, X, + 0) (addition in F,). 

Thus, TXx + ^) = TXx) + T(y) for all x,y €. K,. 

This verifies one requirement for the linearity of T. Again, 

Tlax) = r(«Xi, aXj, axj) 

= (axi, «x*, 0) (definition of T) 

= a(Xi, Xg, 0) (scalar multiplication in Vg) 

and 

ar(x) = »T[X„ Xj, Xj) = a(xi, x*, 0) (definition of T). 
Thus, r(*x) = ar(x) for all x £ Kg and all scalars a. 

Hence, both the conditions for linearity of T are verified. So T is linear. 

The reader should note that we have gone through the verification 
rather leisurely. We shall not be able to afford such a leisurely pace in 
the sequel. But every time we say that a map is linear the student would 
do well not to take it for granted but rather to go through the verification 
in as much detail as his understanding demands. 

Example 4,2 Define T : Vg-*- f'* by the rule 

r(Xi, Xg, X,) = (Xj - Xg, Xx + Xs) . 

This is a linear map as we shall now show. 

If X = (xi, x„ Xj) and y = (yx, y,, yg), then 

T{x ■{■y) = T{Xx + yx, X* + >-*, x, + 

= (Xi + .Fi - X, - yg, Xi + + xg + >^3), 

whereas 

T{x) + T{y) = (Xi - Xg, Xi + X,) (yx - y,, y^ + y^) 

=• (Xi - Xg + yx- yg, Xi + Xg + + y,) 

= (Xi + - Xg - yg, Xg+yg + xg+ yg) . 

Hence, r(x + y) == r(x) + T(y) for all x, y £ Vg. The remaining part, 
namely, 7X®^) =“ *^x) can be completed by the reader. Then it will 
follow that T is linear. 

Example 4,3 Define TiVg-*- Vghy the rule 

T(Xx, Xg, Xg) = x} + xi + x5 . 

This is not a linear map, because for x = y = (1, 0, 0) 

IXx + y) = (xi + yg)* + (Xg + yg)* + (x, + yg)* = 4 , 

whereas 

T(x) + T{y) =“ x! + xi + xi + yi + yi + yi ■» 2 . 

Note that even if one of the two requirements of the definition of linearity 
fails, T is not linear. 
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Example 4,4 Define T : U -*• V (U and V being vector spaces) by the 
rule 

T{u) = Ov 

for all u € U. This is a linear map. It is called the zero map, because it 
maps every vector to the zero vector of V. 

Example 4 5 Let 17 be a vector space. The identity mop Iv'.V -*U 
defined by the rule 

Iv{u) u 

is also linear. 

Example 4.6 Define Ti Vt-* Vt by the rule 

T(Xi, ATj) = {Xi, ~Xi) . 

This is a linear map and is called the reflection in the Xj-axis (Figure 4.1). 

1 X 2 



Figure 4 1 

Example 4.7 Define D '. ^ ’"(o, b)-> (a, b) by the rule 

Dif) = r , 

where /' is the derivative of /. The facts that D{J + g) = (f + g)' = /' + g' 
and that X>(a/) — («/)' = »/' are elementary but important results in 
calculus. In view of these results, wc see that D is linear. This trans- 
formation D is called the differential operator. 

Example 4 8 Define ^ (< 7 , ft) -i- /? by the rule 

c‘I(f) = f/(x) dx . 

a 

Again, by the properties of integral, we find that ^ is a linear map. 
Example 4.9 Suppose / 0 is a fixed vector of a vector space U. 
Define T : U -*■ U by the rule 

r(x) = X -I- i/o 

for all X £ (7. This map T is not linear, because 

Kx -1- y) = (X + y) + u* 

^ (* + «,) + (y + «o) = + T{y) . 

This map is called translation by the vector u,. 

4.1,3 Remark The function/ : R defined by/(x) •*> x + a{W fixed) 

is customarily called a linear fhnetion, because its graph in the iqr- 
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plane is a straight line. But it is not a linear map from the vector 
space to itself, in the sense of Definition 4.1.1. 

4.1.4 Theorem Let T : U ->V be a linear map. Then 

(a) r(0„) = 0^. (b) n-u) = ~T{u), and 

(C) TittfUi ... + MnOn) = “lAWi) + ... + 

In other words, a linear map T transforms the zero of U into the zero 
of V and the negative of every u^U into the negative of r(tt) in V. 

The proofs of (a) and (b) are left to the reader. The proof of (c) is 
obtained by induction on *n', starting from the fact that r(au) = <*T{u) and 
using the property 

+ p«j) T(aM,) + Ti^u^) = itT{u^ + pr(i/j) . 

In view of (c), we get a standard technique of defining a linear trans* 
for.nation 7 on a finite-dimensional vector space. Suppose B — {ui, Ug, ...» 
Un} is a basis for {/ Then any vector u E.V can be expressed uniquely in 
the form 

u = «!«, + v..Ui -f- ... + a„«„ . 

So, if 7 : 1/ - F is a linear map, then 

r(M) — T{aiUi -1- ajWg -f ... -f «»«„) 

= a^TT^Mj) -f- aj7(Mg) -f ... -1- a„r(«„) . 

Thus, T{u) is known as soon as r(«i)t T(Ui), ■■■, 7(m„) are known. This 
is formalised in the following theorem. 

4.1.5 Theorem A linear transformation T is compeltely determined by its 
values on the elements of a basis. Precisely, ifB = {Mj, m*, .... m„} is 
a basis for U and Vj, Vg, .■ ,v„ be n vectors {not necessarily distinct) in 
V, then there exists a unique linear transformation 

T :U-^ V 

such that 

T(u,) = V, for i — 1, 2, (3) 

Proof : Let u E.U. Then u can be expressed uniquely in the form 
u =• a,«i + ttgUg -I- ... -f a„w„ . 

We define 

T{u) — XiVi -f agVg + ... -f a„v„ . (4) 

We now claim that this transformation T is the required transformation. 
To prove our claim, we have to show that (i) T is linear, (ii) T satisfies 
Equation (3), and (iii) T is unique. 

(ii) is obvious, since «/ = Owg + ... -f 0«,-i + lu, -1- ... + 0u«, and so 
T{ud — lvi == V, for all i. 

(iii) follows, because if there were another such linear map S with 
S{Ui) = Vf, then 

S(«) = 5(ai«i + ocgM* -f ... 4- *««n) 

= o^S(ui) H- Xt<^(Wt) + — + “ii^(«b) (S is linear) 
=» agVi + ttiV, 4- ... 4- «*v. 
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This is true fot every u ^ U So S = T. 

It only remains to prove (i), which is just a verification of the two 
relations 

T(u + v) = T(u) + ^(v) and 7 («m) = »T{u) 
for arbitrary u, v E U and all scalars «. Let m, v be two vectors of U. 
Then 

« =- «!«! + ••• + ««Mn. V = Pihi -f ... - 1 - P„«„ 

and we have 

M + V = («! -1- Pi)Mi + ... + t«/i + Pn)Mn • 

Hence, by the definition of T, we have 

T{u + v) = (ai + pi)vi + ... + («„ -f p„)r„ . 

Also. 7X«) -h r(v) == (a^Vj + ... + a„v„) + (pjVj + ... + p„v„) 

= («i - 1 - ?i)vi + . . ^ (a„ + [i>„ . 

Therefore, T(u + v) = r(a) + T^v). Again, 

Tfaw) = aaiVi -f- ... 1 - a*,v„ 
a(a,v, 4 - •• + ftnO 
= »TXu) . 

Thus, T is linear and the theorem is proved. | 

4.1.6 Remark Theorem 4.1.S will be used in the following way : To de- 
fine a linear map, very often we shall be content with listing 
7Y«,), T(Ut), .. , r(Mr). This means the value of T on a general « is 
to be obtained by the prr cess shown in the theorem, namely, if 
u = «,«, 4 otjUj, 4- ... I *„w„ , 

then 

Tiu) = ftiTiUi) 4- » 3 T{Ua) f ... 4- . 

This process of defining T on the basis and extending it to the re- 
maining elements is called linear extension cf T. So we shall simply 
say 'Define 7 on a basis and extend it linearly’ or, equivalently, 
‘Define the linear map T by specifying its values on a basis’. 

Example 4.10 Suppose we want to define a linear map 7 : F, -> K 4 . 
Take a basis for F„ say {(1, 1), (1, —1)}. We have only to fix 7(1, 1 ) 
and 7(1, — 1) in In fact, every ordered pair of vectors in F* will give 
us one linear map 7. We shall cite a few in Table 4.1. 

Table 4.1 

Linear map -»• 

Value at 

I 


(0,0, 0,0) (0, 1,0,0) (1, 1, 1. i) (1, 1,0,0) 

( 0 , 0 , 0 . 0 ) ( 1 , 0 , 0 , 0 ) (- 1 ,- 1 , ( 0 , 0 , 0 , 0 ) 

1 , ~ 1 ) 



( 1 . 1 ) 
( 1 , - 1 ) 
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Let US now linearly extend each of these maps to any w E F, The 
actual values of r(M) will depend on the coordinates of u relative to the 
basis {(1, 1), (1. -1)}. 

Let « = Then 

(x,y) = (I. 1) F "^-^-(1, -1) . 

Thus, we get 

Ux,y) = --p’ T, (1. 1) + — ^ Ti (1, -1) 

= ^ (0, 0. 0. Oj + * 2 ^ (0. 0, 0 . 0) - (0, 0, 0 , 0) 

= 0 . 

Therefore, Ti is the zero map. 

Ux,y) - 1) + r*{l, - 1) 

= lO. 1 , 0. 0) + (I. 0. 0, 0) 

T,(x.y) - r 3 (i. 1) -f r,(i, -1) 

= --2-^- 0. 1. J) +C^^)(-1» -I. -1. -1) 

(y, y. y, y) ■ 

T,(x,y) = 1) 4^^-^ uu -1) 

= - ^ (M, 0. 0) + ^ (0, 0, 0. 0) 


Problem Set 4.1 

1 . Let U and V be vector spaces over the same field of scalars, and T a 
map from U to V. Then prove that T is linear iff T^xu^ -f «g) 
= xTitti) + T(Ui) for all «i, E. U and scalar a. 

2. Which of the following maps are linear ? 

(a) T’.V^^V, defined by T{x) = (x, 2x, 3x) 

(b) TiVi^Vt defined by r(x) = (x, x\ x^) 

(c) r : Ff -> Ff defined by T(x, y) - (x + «, y, 0), a 0 

(d) T : Ft -»■ F, defined by Tix, y) = {2x + 3^, 3* — Ay) 

(e) r ; F, ■>*> F, defined by T^jf, y, z) =» (ar* + xy, xy^ yz) 

(0 T : F, -*■ Ft defined by T{x, y, z) = (jr, y) 
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T Kf -► Ff defined by T{x, y) = {y, jr) 

(h) T F, -*• F, defined by 7Xx, y, z) — (x + y + z, 0) 

(i) T 9 -* 9 defined by T{p) ^ p* p 

0) T 9-^9 defined by T(p){x) = xp(x) p(l) 

(k) T y:'[0, 1] -i- F, defined by T(f) = (/(O), /(I)) 

(l) T 9 -* 9 defined by T{p) = p{0) 

(m) T 9 9 defined by t ( p ){ x ) 2 -i- 3.v + 7x» />(jc) 

(n) T.9->9 defined by T{p){x) =-- /!»(0) xp’^) + -J* p'(0) 

(o) T . 9 -'>■ 9 defined by T(p) = />' 

(p) T : b) -> 6) defined by T(f) = a,/' + ... 

+ a.’s arc fixed scalars 

(q) T : 6) - >■ b) defined by T(f) — (3.x* 4- 4)/* 

4 (7.Y 4 3)/' 4 (3x 4 5)/. 

3. Determine whether there exists a linear map in the following cases, 
and where it docs exist give the general formula. 

(a) 7’ : Fj - > Fj such that 7(1 , 2) -- (3, O) and 7(2, 1) = (1, 2) 

(b) 7 ; Fs V Fa such that 7(2, 1) - (2, 1) and 7(1, 2) (4. 2) 

(c) 7 : Fa > F* such that 7(0, 1) - (3, 4), 7(3, 1) = (2, 2), and 

7(3. 2) = (5, 7) 

(d) 7 : Fj > F, such that 7’(0, 1.2)- (3. I, 2) and 7(i, I, 1) 

-- (2, 2, 2) 

(e) 7 : .‘T'a - ^ 9i such that 7( 1 -) .v) • i -I x, 7(2 1 x) 

X -i 3x*, and 7(x*) = 0 

(f) T : 9t -> 9.^ such that 7(1 } x) -= 1 , r(x) =-■ 3, and 7{x*) - 4 

Ig) 7' : F? ^ Ff such that 7(/, i) - (1 r ». 1). 

4. Determine a nonzero linear transformation 7’ : F, ► Vs, which maps 
all the vectors on the line x v onto the origin. 

5. Determine a linear tranformation T: I'i • F^, which maps all the 

vectors on the line x ■} — 0 onto themselves (7 /). 

6. Let 7: F? -> F? be defined by 7(«, i /3i, a, 4 tps) --- K, aj). 

Then prove or disprove that 7 is linear. 

7. Prove that a linear transformation on a 1 -dimensional vector space is 
nothing but multiplication by a fixed scalar. 

8. Prove Theorem 4.1.4. 

9. True or false 7 

(a) There exists a linear transformation 7 : F, ->■ F* such that 
7(0, 0) = (1. 0, 0, 0). 

(b) Scalar multiplication is the only linear transfonqation from F^ 
toFj. 

(c) T: 9 -* 9 defined as 7Xp(x)) = xp(x) is not a linear transfor* 
mation. 
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(d) r ; K, - y, defined by Tl(l, 1) = (I, 0 , 0), 71(2, 1) « (0, J, 0), 
7(0, I) — (0, 0, 1) is not linear. 

fe) Rotation cf coordinates in K* defined as (jf, y) t— ► (*', y'), 
where x' = .v cos 0 + y sin 6 , y' = —x sin 0 + y cos 0 , is a 
linear transformation. 

(f) Let /i+ be the vector space proved in Problem 2 of Problem Set 
3.1. Lit T : Va -*■ /?* be a linear map. Then 7(0, 0, 0) = I. 

(g) Linear transformations cannot be defined from the real vector 
space C to the complex vector space C. 

(h) Let 7 : {/ K be a map such that T(0u) ^ Ov. Then 7 is not 
linear. 

4.2 RANGE AND KERNEL OF A LINEAR MAP 

With reference to a linear map T : U V, two sets are important. One 
is the range of 7, denoted by R(T) and already defined (cf Definition 
1.4.4) for any function 7 as the set of all 7-images. The other is fV(7), 
the kernel of 7, defined as follows. 

4.2.1 Definition Let 7 ; (/ K be a linear map. The kernel {null space) 
of 7 is the set 

N{T) •= (M € C/ 1 m - 0».). 

It is also denoted as kerT. 

In other words, N{T) is the set of all those elements in U that are 
mapped by 7 into ihe zero of V. Note that this is nothing but the 
7-pre-image of Ov (cf Definition l .4.2). 

As illustration, let us find R(T) and N{T) for each of the linear trans- 
formations 7 defined in Examples 4.1, 4.2, and 4.4-4.8. 

Example 4. It In Example 4 . 1 we have T:Va-* defined by T{Xi, x^, Xg) 

— (Xj, X., 0). 

Here tt(T) is the set of all elements of the form (x^, x^, 0), which is 
nothing but the x,x, -plane in P,. This also says that 7 is not onto 
(cf Definition 1 .4.3). 

To determine M(T), the kernel of 7', we want all those vectors 
(x„ Xj, X 3 ) for which 7(Xj, Xj, Xj) = 0. This means (Xj, x*. 0) == (0, 0, 0). 
So Xi « .Xg — 0, In fuct, any element of the form (0, 0, Xg) would be 
mapped by 7 into (0, 0, 0). No other element would be so mapped. 
Therefore, M(T) is the set of all elements of the form (0, 0, x,), which is 
nothing but the Xg-axis in Pg. 

Example 4 12 In Example 4.2 7 : P, -* Pg is defined by 71(Xi, x,, x,) = 

(.Xi — X„ Xg + Xg). 

In this case R{T) consists of vectors of the form (Xj — x,, Xg + x,). We 
want to determine the vectors of P| that are of this form. For this, take 
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a vector (a, b) in F, and solve the equation 

(Xi - X*. Xi + X,) = (a, b) . 

This means Xj — x* = a and Xj + x, == b. Solving these, we get 
X, == Xi - a, Xa = 6 — Xi , 

Hence, 7(Xi, Xy — a,b — xj = (a, b). This shows that every vector 
(a, b) of Fj is in R{T). In other words, R{T) — Fj,. So this is an onto 
map. 

To determine the kernel, we solve the equation r(Xi, x.., Xj) = (x^ — 
x,) = (0, 0). This gives x, == .v* — - Xj, i.e. all vectors of the 
form (Xi, Xj, — Xi) will be mapped into zero. So 

N(T) «= {.\i(l, 1, -1) 1 Xi any scalar} = [(1, 1, -1)] . 

This is the subspace of Fj generated by (I, I, - 1). 

Example 4.13 For the zero map (see Example 4.4) the range is fOy} and 
the kernel is U. This is clearly not .in omo map. 

Example 4.14 For the identity map lu (see Example 4.5) the kernel is 
{Oy}. The range is U, so the map is onto. 

Example 4.15 In Example 4.6 T : Fg-^-F^-is defined by Tix^, Xg) 
= (Xj, — Xj). Here R{T ) Fj and N(T) = }(0, 0»}. This is an onto map. 

Example 4.16 In Example 4.7 D : h) ■> y b) is defined by 

In this case I?(D) / (a, h), since every continuous function 
g on (a, b) possesses an antiderisative and hence D is an onto map. 
N{D) is the set of all constant functions m >‘’(fl, h). 

Example 4.17 In Example 4.8 4: y'^,b)->-R is defined by J(/) 

= /^./(x)</x. Here the range is the whole of R, since every real number can 
be obtained as the algebraic area under some curve y — fix) from a to b. 
Therefore, it is an onto map. The kernel is the set of ail those functions 
‘/’ for which the area under the curve y — fix) from a to fr is zero. It is 
difficult to say anything more than this about the kernel. 

We shall now check whether the linear transformations discussed in 
Examples 4.1 1 to 4.17 are one-one (cf 1.4.7 for the definition of one-one). 

In Example 4.1 1 JV(T) is the Xj-axis. So all points on the .Vj-axis go 
into (0, 0, 0). So this map is not one-one. 

In Example 4.12 == 1(1, 1. “OI- So, many poigts go into 

(0, 0, 0). This again means F is not one-one. 

In Example 4.13 N(T) = 17. So the zero map is not one-one, because 
all elements go into the zero of F. 

In Example 4.14 the identity map is one-one, because, if x # y, then 
certaWy /(x) /(y). It may be noted that Nil) is the zero subspace of 

U, 



116 f UNkAR TRANSFORMATIONS 

In Example 4.15 the linear map T is one-one, because if(XuX,) 
^ Oi. >’»), then (xi. —Xt) is also not equal to (y,, —>'*). Observe that in 
this case also N{T) is the zero subspace of V». 

In Example 4.16, since different functions (say those that differ by 
a constant) have the same derivative, the map D is not one one. Observe 
that N(T) is a nontrivial subspace in this case. In Example 4.17 the linear 
map T is not one-one. (Why ?) 

Summarising these observations, it appeals that T is one-one when 
N(T) is the zero subspace and conversely. This is, in fact, true as a gene- 
ral statement, as is borne out by the following theorem which gives, in ad- 
dition, more information about it(r) and N(T) 

4.2.2 Theorem Let Ti U V be a linear map. Then 

(a) R{T) is a subspace of V 

(b) N(T) is a subspace of U. 

(c) T if one-one iff N{T) is the zero suhspace, (Qy), tf U. 

(d) //[Hi. u, ««1 - U, then R(T) - [r(«,), T(u.), .. , nt/J]. 

(e) If U is fimte-dimensional, then dim jR(T) < dim U. 

Proof : (a) Let Vj, Vg G RiX)- Then there exist vectors i/,, in V 
such that r(«i) t’l and TfUg) = Vg. So 

Vj -f Vg = r(i<j) 1- T{Ui) -- r(i/g 4 «g) , 
since T is linear. But t/g 4 «g G U, since U is a vector space. Hence, 
Vj -f Vg is the image of an element of U. So Vg -t- v* G R{T). In the same 
way, «Vj ■= <».T(ui) — since T is linear. But awg G U, because U is 

a vector space. Hence, *Vj G RiT). Thus, R(T) is a subspace of K. 

(b) Let «g G N(T). Then TiuJ = Ov and /’(wg) — Ov, I'ecause this 
is precisely the meaning of their being in N(T). Now 

r(«i -1- «g) = r(Mi) F n[M.g), since T is linear 

0^ -t Oy ~0y, 

which shows that Wg 1- Wg G bf{T). Similarly, for all scalars a, we have 
r(aHg) — «r(Mg), since T is linear 

= «0y = 0,, (Theorem 3.1.7) 
which shows that on/g G N{T). Thus, iV(7’) is a subspace of U. 

(c) Suppose T IS one-one. Then TXm) = TXv) implies u .-= v. If 
u G N{T), then r(«) = Ov = TXOo). Therefore, a = Oo. This means no 
nonzero vector uofU can belong to NiX). Since Ov in any case belongs to 
N{T) (why ?), it follows that N{T) contains only Ov and nothing else. 
Hence, N(T) is the zero subspace of V. 

Conversely, suppose NiT) =• {Ov}. Then, to prove that T is one-one, 
we have to prove that TXm) **« TXr) implies « » v. Suppose TXm) ™ TXv). 
Then 

TTm — v) TXm) — TXv) ■= Ok . 
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So « — V G N(T) = {Oi/}. So 1 / — V = Op, i.c. « = v. This proves that T 
is onoK>ne. 

(d; Let [«!, u,, Un] = U, Then each vector u can be expressed as 
a linear combination of vectors «i, Uj, The vectors T{u^, 
TXut), T(u„) are in RiT). So, obviously, [r(«i), r(«a\..., r(a„)l C R{T). 
Let V G R{T). Then there exists a vector uE. U such that T(u) — v. Since 
uEV — K, «*, ..., «J, we have 

u = ajM, a,Ug + ... + . 

Therefore, v = TXm) = + ... + <»«»») 

= a-iT{Ui) + + ... + »nT(u„) . 

So V G t^Xwi). T(Un)]. This proves that 

RiT) = [r(M,). r(a,). ..., r(M»)i . 

(e) The proof is left to the reader. | 

We shall conclude this article with a definition. 

4.2.3 Definition Let T : U -*-V he a. linear map. Then 

(a) If it(r) is finite*dimensional, the dimension of RiT) is called the 
rank of T and is denoted by r(r). 

(b) If NiT) is finite-dimensional, the dimension of NiT) is called the 
nullity of T and is denoted by n(r). 

We shall study these concepts at length in § 4.3. 

Problem Set 4.2 

1. Determine the range of the following linear transformations. Also 
find the rank of T, where it exists. 

(a) T : Vi-> Vt defined by Tix^, = (xi 4- Jfi) 

(b) T: K, -> Ka defined by r(jfj, x^ = (x^, Xj -t- x^, x*) 

(c) T: K, -> Ka defined by r(x„ x*, Xj) = (ixi + x* + Xa, 

Xi -Jxa, Xa) 

(d) r : Fa -> Ka defined by r(xj, x*, x,) = (x„ Xj, x*) 

(e) T : Fa F, defined by TXxj, x„ x„ x*) = (Xj — x*. x, + x,, 

Xi — 

(f) r : F, F« defined by TXxj, x,, Xa) = (xj, Xi + x„ Xj -f- x, 

+ Xt, Xj) 

(g) T: F« -»■ Fa defined by TXxj, x*, x„ Xa) = (3xa + 2xa, x^ — x„ 

Ixi - Xa, X,) 

(h) T'. g> -*■ g> defined by 7Xp)ix) = xp(x) 

(i) T: 9-* 9> defined by 7 XpK*) = xp'ix) 

0) T: SP-*^ 9 defined by r(p)(x) = p'(x) - 2p(x) 

(k) T: 1) ->^(0, 1) defined by IX/)!*) *= fix) sin x 

(l) r : 1) (0, 1) defined by n/)(*) “ fix)tf. 

2. Determine the kernel of the linear transformations of Problem 
(a)'(l). Also find the nullity of T, where it exists. 
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3. Let T:V -*W be a linear map and U a subspace of V. Define 
TiV) = (w € /V I w = T(u) for some u G £/}. Then prove that 
1X0 is a subspace of IT. 

4 . Let T: V -*-W be a linear map and a subspace of W. Then 
prove that the set {v G y\ T(v) G W'l) is a subspace of V. 

5 . Let a,!, a„, .... ai„, a*,, a,,, a,i, .... be any pn fixed 

scalars. Let T: Vn-*- F, be a linear map defined by 

Tfci) = (*ii> *2n •••» *!>()» 1 “ 1» 2, n. 

Then prove that 

(a) T is not one-one if p < b 

(b) T js onto whenp = n and (ku. («i2. *1.2), .... («i*, 

(x,p) are Li. 

6. Find a linear transformation T: K3 -> K, such that the set of all 
vectors (v„ Xj* ^a) satisfying the equation — 3 Xj x, = 0 is the 
kernel of T. 

7 . Find a linear transformation J : F, -> K, such that the set of all 

vectors (xi, x*, x,) satisfying the equation 4 .Vi — 3x2 + == 0 is 

the range of T. 

8 Pick out the maps in Problem 1 that are 

(a) one-one (b) onto (c) one-one and pnto. 

9 . True or false ? 

(a) Every constant map from one vector space to another is both 
one-one and onto. 

(b) A linear transformation TtKj-^Ki defined as r{l, I) 
= (1, 0, 0, 0) and 7(1, 2) = (2, 0, 0, 0) is one-one. 

(c) Every linear transformation from Fj, to itself is onto. 

(d) No linear transformation from to F, is onto. 

(e) There exist one-one linear transformations from F, to F2. 

(f) If T : CA -> F is a linear transformation and Vo G F, then the 
T-pre-image of is a subspace of U. 

4.3 RANK AND NULLITY 

A careful scrutiny of Table 4.1 shows that the image of a linearly 
independent set by a linear map need not be u. The following theorem 
throws light on this situation. Essentially, it says that a one-one linear 
map will preserve linear independence, whereas under any linear map the 
set of pre- images of a linearly independent set of vectors is u. 

4.3.1 Theorem Let TiU -*V be a linear map. Then 
. (a) I/T is one-one and u„ u,, are linearly independent vectors 

ofU, then T(ui), Tiu^ r(u«) are li. 

(b) If V|, v„ ..., V* are linearly independent vectors of i?(T) and 
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Wi, u,, M, are vectors of U such that T(ui) = Vj, T(u^ = Vj, 
r(M«) = then u^, are Li. 

Proof : (a) Let T be one>one and Mj, u,, u„ be linearly indepen* 
dent vectors in U. To prove that T{u^, T{u^, T{u„) are li, we 
assume 

*i^(**i) + + ••• + <^nTiu„) — 0 

or + «*«» + ... + «n««) = 0, 

since Tis linear. So a,tti + a^n, -f ... 4- a^w* = 0, since T is one-one. 
But Ui, Ug, ..., u„ are li. So = 0 = a, = ... = a^. 

Thus, a,7^uj 4- + ••• + = 0 implies that each a< is 

zero. Hence, Tiuj), T(ut), .... r(Uft) are li. 

(b) Let Ux, Ug, ..., u„ and v^, y,, ..., v„ be as stated in Theorem 4.3.1. 
To prove that Ug, Ug, ..., u« are li, suppose 

+ *a“* + ••• + *»“» ~ ® • 

Since T is linear, we have 

Ok = ITOu) = T(ctiUi 4* 4- ... + *»w«) 

or o^iTCui) + «,T(Ug) + ... 4- x„r(u„) = Ok 

or ajV, 4- a,v, 4- ... + a„v„ = Ok . 

But Vj, V,, ..., V, are Ll. Therefore, a, = 0 = a* = ... = 

Thus, XgUi 4- «tM* + ... + *««n = 0 implies that = 0 = a, = ... 
— <x„. Hence, Ug, u„ ..., u„ are li. | 

Example 4.18 Prove that the linear map 7 : K, Fj defined by T(eg) 
= e, — eg, 7(e,) = 2e, + e„ T(eg) — Cg + eg + Cg is neither one-one nor 
onto. 

Since [«„ ej == F,, by Theorem 4.2.2 (d), 

J?(7) = ir(e,), 7(ej), Tfe,)] = (e, — eg, 2eg 4* ^3, ^1 + + «sl 

= [«i — 2^8 + e,] , 

because eg + eg + eg is a linear combination of Cg — e, and 2e* 4- c,. 
Now we see that eg — eg and 2e, + e, are Li. So dim RyT) = 2. 
Therefore, R(T) is a proper subset of F,. Hence, 7 is not onto. 

To prove that 7 is not one-one, we check N(T). N(T) consists of 
those vectors (x,, Xg, x,) in F, for which 

Tixg, Xg, X,) = 0 

or T(Xgeg -f- XjC* 4- Xgpg) = 0 

or "I" 4" ~ ® » 

because 7 is linear. Thus, 

(*i 4- *3, — *1 + 2x, -1- x» X, 4- *3) = (®» ®* ®) • 

Le. Xi -1- X, == 0, Xj 4- *3 “ 0, and — x, -I- 2x3 -1- X3 = 0. • Solving these, 
we get Xj = X, s= —X,. Therefore, 

Mr) = {(^it Xg, — Xj) I Xi an arbitrary scalar} = 1(1, 1, —1)1 • 
Hence, by Theorem 4.2.2, 7 is not one-one. 



120/ UNBAJl transformations 

la Example 4.18 the liaearly independent vectors ei, e%, and e* span the 
domain space Vg, but their images e, — 2e, + e,, and ej + e* + e* are 

LD and dim = 2. 

Thus, we find that the effect of the linear map T on 17 =» K, is to 
shrink to a 2-dimensionaI subspace R{J) of V = V^. What happens 
to the remaining ‘one’ dimension ? 

Observe, in this case, that the kernel of T is [(1, 1,-1)] and so 
dim N{T) = 1 . Thus, it appears that in this example 
dim R(J^ + dim N(T) — dim . 

This is not an accident. A general result of the same kind is true for 
ail linear maps whose domain space is finite-dimensional. We shall now 
record this as a major theorem. 

4.3.2 Theorem (Rank-Nullity Theorem) Let T : U V be a linear map 
and U a finite-dimensional vector space. Then 

dim R(T) -f dim N(T) = dim U . (1) 

In other words, 

r(r) + n(J) = dim U (2) 

or rank -f- nullity = dimension of the domain space. 

Proof : N(T) is a subspace of a finite-dimensional vector space U. 
Therefore, N{J) is itself a finite-dimensional vector space. Let dim 

N{T) = n(T) - n and dim (/ -- p (p > «). Let B = {Ui , «, i/„} be a 

basis for NiT). Since «. £ NiT), Tiu,) = 0 for each 1=1,2, .... n. B 
is LI in NIX) and therefore in U. Extend this linearly independent set of 
If to a basis for U. Let Bi = {«i, m„ .... u„+i, ..., «,} be a basis for 

U. 

Consider the set 

A — {T(u„+j), TXmh+j), ..., T(Up)} . 

We shall now prove that .4 is a basis for R{X. Observe that, if this is 
proved, the proof of the theorem is over; for, this means 
dim /i(r) = p - n = dim 17 - dim NiT) , 
which is the same as Equation (1). 

It is therefore enough to prove 

(i) [.<1 = /?(r), and 

(ii) A is LI. 

To prove (i) we proceed as follows : Since [ffi] = U, it follows from 
Theorem 4.2.2 (d) that 11(70 = [n«i). W. .... 7X«.). •*., Wl- 

But TiUi) = 0 for I = 1, 2, ...» n. Hence, 

BiT) — [7(Wn+i), 7Xu„^i), ..., T^Up)] . 

To prove (ii), consider 

«rt+i7X««+i) + ... + *pTiu,) = 0 . (3) 

Using the fact that T is linear, we get 

+ ..., + «,«,) « 0 , 
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m 

which means that + ... + a,«, e N(T). Therefore, a,H-i«»+i 

+ ... + is a unique linear combination of the basis B for N(T). 
Thus, 

«iM-lWn+l + ... + <^JUp = Pi«l + ... + P«W« , 

i e. Pi«i + ... + — ... — = 0 . 

Bx being a basis for U is li. Therefore, 

Pi = P. = ... = Pn = «*+i ==...=«, = 0 . 

Thus, Equation (3) implies a„+i = ... = a, = 0. Hence, A is li. | 

Example 4.19 Let J : K4 -> F, be a linear map defined by /(e,) 
= (1, 1, 1), r(e*) = (1, -1, 1). Tie^) = (1, 0. 0), = (1.0. 1). Then 

verify that r(r) + m( 7') = dim £/ ( = K4) — 4. 

We know that R(T) = [(1, 1, 1), (1, -1, 1), (1. 0, 0), (1, 0, 1)]. 

(1, 1, 1), (1, —1, I), (I, 0, 0), and (I, 0, 1) are ld, because a set of four 
vectors of K3 (dim = 3) is always ld. We find that 

(1. 0. 1) = i(i, 1. 1) 1- i(i. -i. 1) + 0(1. 0. 0) . 

Hence, we can discard the vector (1, 0, 1). so that 

RiX)^ [(1, 1, 1), (I. -1,1), (1,0,0)]. 

To check whether (U I, 1), (1, —1, 1), and (1, 0, 0) are li, we suppose 

a^Cl. 1, 1) + «4(1, -1, 1) + a3(l, 0, 0) = 0 - (0, 0, O') 

or («i + <*2 + «3. *1 -- «1 + «2) = (0, 0 , 0) . 

Solving this, we get aj = 0 == = aj. Hence, (I, 1, 1), (1, —1, 1), and 

(I, 0, 0) are li and dim jR(r) = r{T) — 3. 

Now to find W(r), we suppose that r(M) = 0 = (0, 0, 0). If 

u = (jTi, JC3, Xa, *4) = Jfjei + jrjfa + ^3^* + , 

then T(Xx, *2, .^3. *4) = TiXiPi + Xje* + x^e^ + *4e4) = (0, 0, 0) 

or (JCi + Jfa + ^3 + ^4. .^1 — Xx, + *2 + X4) = (0, 0, 0) . 

Solving this, we get Xx = x^ — —xJ2, x, = 0. So N{T) contains the 
vectors of the form (x„ Xj, 0, — 2xi), i.e. N{T) — [(1, 1, 0, — 2)]. So 
n(r) = dim N{T) = 1. Hence, r(T) + n(T) = 3 + 1=4, and the 
theorem is verified. 

Problem Set 4.3 

1. Let t/ bc'a vector space of dimension n and T : 17 -»■ K be a linear 
and onto map. Then prove that T is one-one iff dim K = n. 

2. If 7 : (7 -»■ F' is a linear map, where U is finite-dimensional, prove 
that 

(a) n{T) < dim 

(b) r{T) < min (dim U, dim V). 

3. Let Z be a subspace of a finite-dimensional vector space U, and V a 
finite-dimensional vector space. Then prove that Z will be the 
kernel of a linear map Till -*-V iff dim Z > dim U — dim V. 
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4. Prove Theorem 4.3.2 by the following method : Assume a basis 
{yv yf, yr) for P(r) and Ur in U such that TM « y^ 

/= 1, 2, r. Assume a basis {tv^, for N{T). Iben 

prove that {ui, ...» i/r, w^, h'„} is a basis for [/. 

5. True or false ? 

(a) No linear transformation from K 4 to K, car be one-one. 

(b) If r : K, -► Kg is linear and one-one, then it is onto. 

(c) Let r : Fg K, be a linear map. Then R(T) can be a 4-dimen- 
sional subspace of F,. 

(d) Let r : 1/ -> F be a linear map (U and F arc finite-dimen* 
sional vector spaces). If T is one* one, then dim U < dim F. 

(e) Polynomial functions p of degree less than or equal to 3 such 
that/; p(x)dx = 0 form a 3-dimensional subspace of d’g. 

4.4 INVERSE OF A LINEAR TRANSFORMATION 

Linear transformations that are both one-one and onto play an 
important role. We give them a special name in the following definition. 

4.4.1 Definition A linear map T: U V is said to be nonsingular if it is 
one-one and onto. Such a map is also called an isomorphism. 

We know that any function has an inverse iff it is one-one and onto 
(cf Definition 1.7.8). Hence, we have the following fact. 

44.2 Fact A linear transformation is nonsingular iff ii has an inverse. 

Let us illustrate this by the following examples. 

Example 4.20 Consider the map T : -► Fg defined by T^ag + a^jc 

+ ~ (<^ 0 * ^ 1 ’ ^ 2 )* Clearly, T is a linear map (check !). This is 

onto, because given a vector (Pj, ^,) in Fg we can get a polynomial 
Pi + M of which (Pi, Pg, Pg) is the T-image. 

Further, T is one-one, because if p^ 0 = Pg = pg, then the poly- 
nomial Pg + PgX + Pgx‘ ulso Tcduces to the zero polynomial of f^g. Thus, 
r is an isomorphism. It is easily seen that F, -► ’g>^ is defined as 

“t. * 1 ) = *1 + *1* + «»** • 

Exan^le 4.21 In Example 4.1S we have J : F. -> K. defined by T(Xi, 

» (xp — X|). We have already seen that T is one^ne and onto. 

To calculate yi)i we have to find the element that maps into 
(y„ y,) by T. The answer is (yi. — .y*)* because 

-y^ == (yi. - (-y.)) = (yi. y») . 

Thus, r-* ; F, -> K, is defined by r** (yi. y^ = (yv -y*)- 

Exan^k 4,22 We have already seen that the identity map lu’.U -*■(/ 
defined by /& («) suforallHE Vk one-one and onto. So the inverse 


l!flL 
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of /, i.e. /y‘f exists as a map from V to V. Obviously, = u for 
all u&U. Thus, = la. 

In Examples 4.20-4.22 we can chedc that T~^ is linear. In fact, this is 
in general true as proved in the following theorem. 

4.4.3 Theorem Let T:U ->-V be a nonsingular linear map. Then 
T~^ ’.V-*-Uisa linear, one-one, and onto map. 

Proof : To prove the linearity of T~^, let Vi, V| £ V. Let 
T~\vi) = Ui and = i^. Since T is one-one and onto, «i and h« 

exist uniquely. Thus, Vi = T(ui) and v, = So 

vi + V, = nui) -f- T(ut) = T(ui -f «*) , 
since T is linear. Therefore, 

J'Hfi + Fj) = «i -i- M, = + r-v,) . 

Again, «vi = ar(«i) = T{9.Ui). So 

r"*(avi) = aui = «r"*(vi) . 

Hence, T~^ is linear. 

T~^ is onto because, if « £ t/, then T{u) = v belongs to V, and 
T-^v) = M. 

The rest of the proof is left to the reader. B 

The linear map r : K, -»• defined in Example 4.18, does not have 
an inverse, because it is neither one-one nor onto. 

A linear transformation T :U -*-V has an inverse, if the following two 
properties hold : 

(i) T is one-one. 

(ii) T is onto. 

If one or both of the properties fail to exist, then T~^ does not exist. 

In order to check whether T is one-one, we have to find Nif^. If NIX) 
is the zero subspace, then T is one-one, otherwise it is not. The second 
property, namely, T is onto, holds iff JUT) = V. This involves the 
determination of i?(T), the range space of T. 

4.4,4 Remark Instead of calculating the kernel, if we can somehow find 
(perhaps by guesswork) more than one vector in U, which maps into 
the same vector in V by T, then this would be mtough to prove that 
7*"* does not exist. In the case of Example 4^8 7T1, 1,0) 
= (1, 1, 1) and 7X2, 2, -1) = (1, 1, 1). 

Just from this we could have concluded that T does not have an 
inverse. However, the method that involves finding the kernel is re- 
commended to the reader, since it is applicable in most cases. 

We shall now consider two more examples in which 7*^^ does not exisL 
because in one case T is one-one but not onto, and in the other case T is 
onto but not one* one. 
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Example 4.23 Let U be the set of all infinite sequences {xi, Xff ,..f Xfip ...} 
of real numbers. Define the operations of addition and scalar multipli- 
cation coordinatewise as in K,, i.e. if 

X ** •••» ^nf •••} 

and p = {pi, pt, .... Pn, ■■■} f 

then X + a= {jci + pi, Xt + , x„ + J'«, ...} 

and ax = {axi, aXj, ax„, ...} . 

The set U with these two operations becomes a real vector space (check !). 
Note that the sequence {0, 0, .../O, ...} is the zero of U and {— Jfi, 
— Xj — x„, ...} is the negative of x. 

Let T :U -*■ U bt defined by 

T{x) = T({Xip X^, Xn, •••}) 

^ 3 » Xfip •••} • 

It is easy to check that T is linear. Here R(T) — U. For, take the 
sequence {pi, p^, Pn , Its pre-image by T can be any sequence of 
the form {z, yi, y*, where z can be a real number. In parti- 
cular, z can be zero. Hence, T is onto. 

But T is not one-one, because all the sequences {z, yi, y 2 y#, ...} 

map into {pi, y*, .... Pn, •••}. Further, N{T) is the set of all sequences of 
the form {z, 0, 0, ..., 0, ...}. 

Thus, though T is onto it does not have an inverse, since T is not 
one-one. 

Example 4.24 Let U be the vector space of Example 4.23. And let 
T: U -*■ U he defined by 

•••» ••}) “ ^ 1 * •••* ^n> •••} • 

Obviously, T is linear (check !). Now T is one-one, for N{T) is the set of 
all sequences of the form {0,0,0, ..., 0, ...}. There is only one such 
sequence, namely, the zero element of the space U. So NIX) — {Ov}. 

But T is not onto, because the element {1, 1, 1, ..., 1, has no pre- 
image in U. So RiX) T* U. Hence, T does not have an inverse. 

In Examples 4.23 and 4.24 we produced situations where just one of the 
two conditions, namely, (i) T is one-one, (ii) T is onto, holds and the other 
does not hold. Further, note that in these examples the space U Involved 
is not finite-dimensional. (Why 7) When U is finite-dimensional, we may 
not be able to produce such an example, because of the follow ing 
theorem, which essentially says that if J : C/ F is a linear ma p and 
dim U — dim K, then the two conditions (i) T is one-one and (ii) T is onto 
are implications of each other. 

4.4.5 Theorem ff V and V are finlte-dimensional vector spaces of the same 
dimension, then a linear map T:U -*■ Vis one-one iff it is onto. 
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Proof : T is one-one N{T) «= {0} (Theorem 4.2.2) 

' niT) =» 0 (Definition 4.2.3) 

<* r(r) = dim V = dim K (Theorem 4.3.2) 
R{f) — V (Theorem 3.6.13) 

T is onto. I 

Now we shall take up an example where the inverse exists and we 
proceed to calculate it. Recall that a linear map is completely determined 
as soon as its values on the elements of a basis are specified. Therefore, 
in order to determine the linear map T~^y it is enough to determine the 
values of 7^^ on the elements of a basis. 

Example 4.25 Prove that the linear map T : K3 -> K* defined by T(e^ 
— 4- Pj, = P* + e*, T(e^) = Oi + + Cg is nonsingular, and 

find its inverse. 

First, let us find the value of J at a general element u = (xi, x,, Xg) : 
T(xi, Xj, Xj) = r(x,e, + XgCg + XgCg) 

= (*i + Xg, X, + *2 + JCs, Xg + Xa) . 

If TXxi, Xj, Xj) =,0, then 

+ Jfa = 0, Xi + Xa + Xj = 0, x* + Xg = 0. 

Solving these, we get Xi = 0 = Xj = Xj. So NiT^ = (OKa) and hence T 
is one-one. It follows from Theorem 4.4.5 that T is also onto. Hence, T 
is nonsingular and T~^ exists. 

Now we shall give two methods to find the inverse, T'^, which is also a 
linear, one-one, and onto map from Vg to K3. 

Method / We have ^ Cj + eg, T(eg) — Cg + eg, Tfe,) = ei -f e. 
+ eg. Therefore, 

- T:\e, -f eg) = T-\e,) + 
eg = T-\eg -f eg) = T-\eg) -f T-\eg) 

Cj = T ’(?! + eg + fa) 

= T-\e,) + r\eg) -f T-\eg) , 

because is linear, one-one, and onto. Solving these three equations 
for r~Vi)- P~Keg), and I'Keg), we get 

= (0. -1, I) 

T-^eg) = eg + eg- eg^ (1, 1, -1) 

3^Va) = ^a-^i = (-1.0,1). 

Now we extend T~^ linearly and obtain 

r-\xu Xg, Xg) = r-*(xiei 4- XgOg -f x,e,) 

= XiT-^ed 4- XgT-\eg) + x,r-»(e,) 

« (Jti - »s. “ Xu Xi - X, 4- *i) . 

Method 2 Let T^Xg, Xg, x,) (pt, yg, jp,). llien 
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or TXyi^i + yfy ■**» ^3^ 

or yiJXei) + y,TXe,) + y,7Xe^) - (x^ jr„ .r,) 

or Cxi + ^ 3*^1 i~ (yt ~h y’i "f" O^a "I" .Fa^^a “ Xj, Xg) 

or (yt + ya. yt + ya -h J's. ya + y$) ^ (•»!. Xt, Xg) . 

This gives yt f .Vj ^ Xi, j', + y^ -f- yg == jr„ and yg + yg == Xg. Solving 
these, we get yt — Xg — Xg, yg = Xg — Xg, and yg — Xi~Xg + Xg. So 

r\xt, Xg, Ofj) = (xg - Xg, Xg — Xg, Jf, — jr, + .T,) . 

Problem Set 4.4 

1. Let R, S, and T be three linear maps from F, to Vg defined by the 
values in Table 4.2. Determine which of them are nonsingular and 
in each such case find' the inverse. 

Table 4.2 

Value at -> 

eg eg 

Linear maps 

i- 


R 

ey 1 

<*2 

^1 - <^2 + ^3 '^1 

t 4ei 

S 

- 



- - 7e3 

T 

- 

+ ^3 

3e, — 5^3 3 pj 

-2e, 



2. Show that each of the following maps is nonsingular and find its 
inverse : 

(a) T: Vg j- Vg defined by T{Xi, Xg) *gXg), where »g and a, 

are both nonzero. 

(b) T:Vg-> Vg defined by T(Xt, x,, .Vj) -- (jc, + Xg I Xg, Xg -! .v., 

-'a)- 

(c) r : ‘/’’j - > i/'g defii.cd by T{v„ I a-gX |- a^.x') — t «i) -1 
(.*1 -I 2*g)x + (»o i «j J»i)x\ 

3. Let U be the subset {p € i? | p(0) -- 0} of Then proxc that the 
derivative D is a nonsingular linear map from U to Sf, and the 

integral (c‘t(p)K'^') p(x)dx is its inverse. 

4. Let T •. U > F he a nonsingular linear transformation. Then prove 
that (7 -‘r’ --- T. 

5. True or false ? 

(a) Fvery linear map from F, to F, has an inverse. 

(b) The inverse of a nonsingular linear map is nonsingular. 

(c) A nonsingular linear map transforms linearly independent sets 
into linearly independent sets. 
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Id) A nonsingular linear map transforms linearly dependent sets 
into linearly dependent sets. 

(c) Every translation of K* to K, has an invcrst. 

(f) Every translation of to is an isomorphism. 

(g) Given two vectors ti^, G U, there exists an isomorphism 
T: U U such that r(wi) - t/.^. 

4.S CONSEQUENCES OF RANK-NULLITY THEOREM 

The results discussed in § 4.4 and certain allied facts arc important for 
further discussions. We collect them together in the following theorem, 

4.5. t Theorem Let T : U V he a linear map and dim U ~ dim K = p. 
Then the following statements are cquixalent : 

(a) T is nonsingular (an isomorphism). 

(b) T is one-one. 

(c) T transforms linearly independent subsets of V into linearly inde- 
pendent subsets of V. 

(d) T transfbrms every basis for U^into a basis for V. 

(e) T is onto. 

(f) riT)=-p. 

(g) n(T) r- 0. 

(h) <• r* ' exiits. 

Proof: (a) > (b) by IXfinition 4.4. 1. 

(b) (c) by Theorem 4.3.1(a). 

(c) > (d). Lcl T transform linear!) independent subsets of U into- 

linearly independent subsets uf R{T). Now*, let {Mi, Wj, be a basis 

for U. Then are li by hypothesis. But dim K 

-- p. So {r(Mi), IS a basis for Kby Theorem 3.6.7. 

(d) -> (c). Let {w„ Wj, ..., be a basis for V. Then, by hypothesis, 
(Tfuj), 7\uff , ..., T(Uf)) is a basis for V. This means, by Theorem 4.2.2 (d), 
R{T) — V. Hence, T is onto. 

(e) => (fj. T is onto -> R{T) - V > rfF) — p. 

(1) (g) by the Rank-Nullity theorem. 

(g) (h). n{T) 0 means N{T) - {Ou}, i.e. T is one-one. So T is 
onto by Theorem 4 4.^. Hence, T * exists. 

(h) -> (a) by Fact 4.4.2. § . ^ * 

We shall conclude this article by exhibiting an important isomorphism 

of linear algebra. 

4.5.1 Definition Two vector spaces V and V are said to be isomorphic if 
there exists* an isomorphism from U to V. If U and V arc iso- 
morphic. then we write V at V. 



transformations 

4 . 5.3 Tbeorem real (complex) vector space of dimension p is iso- 
morphic to Vp (V^. 

Proof'. Let 17 be a real vector space of dimension p,B>= {Uj, 
Uf, Up) an ordered basis for 17, « an arbitrary element of 17, and 
(«!• *t> *p) coordinate vector of u relative to B. Consider the map 

7 : U -*■ Vp defined by 

7Xu) = («!, «„ .... ttp) . 

This map is easily seen to be linear; for, if 

u = (tjUi + 0 , 1 ^ + ... + a^p 
and V = + Pitf* + ... + PpMs , 

then u + V = (aj + p^j + («, + Pj)a, + ... + («, + . 

Hence, the coordinate vector of « + v relative to B Is (a^ + Pj, 
** + P*f •••« "I" P»)- So 

T(u + v) = («, + Pi, «2 + P*. •••, *j. + Pp) . 

But 7X«) + r(v) = (a„ a a,) + (P„ p„ ..., p,) . 

Therefore, 7X« + v) = 7\u) + T{v ) . 

Similarly, /(aw) = oT(u). 

Further, T is - one-one, because T{u) = (a„ a,, ..., a,) = 0^ means 
= 0 = ttg = ... = «*, which implies « = Oi/t 0«, + ... + On, 
= Oy, i.e. N{7) = {Oy}. Thus, by Theorem 4.5.1, T is an isomorphism. 
Hence, there exists an isomorphism from U to Vp and consequently 
U a Fp. The proof of the other p.irt Is left to the reader. | 

Example 4.26 In Example 4.20 we have seen that T : . 9*3 -»• F 3 defined by 
T(*p -h eiiX + = (<* 0 , «i, * 3 ) is an isomorphism. Thus, £?* as F,. 

Theorem 4.5.3 says that not only < 7*3 but also any real vector space of 
dimension 3 is isomorphic to F 3 . 

Problem Set 4.5 

1 . Prove that ‘ as ’ is an equivalence relation. 

2. Let A be the subspace of V^ defined by 

4 = {(Jfi, jc„ X 3 , x^) I Xj = 0 }. 

Prove, by exhibiting an isomorphism, that A as F,. 

3. Let B be the subspace of < 7*4 defined by 

B^{p\ pV) = 0.p*(l) = 0}. 

Prove, by exhibiting an isomorphism, that B a Vp. 

4. Prove, by exhibiting an isomorphism, that Acs B, where A and S 
are subspaces of Problems 2 and 3. 

5. True or false ? 

(a) The differential operator D: Pp-*- Pn-i bns nullity zero. • 

(b) There exist two isomorphisms from 9% to F,. 
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(c) In K, all nontrivial subspaces are isomorphic. 

(d) Rotation in F, is an isomorphism. 

(e) Let 7 : K -> F (F is a finite-dimensional vector space) be a linear 
map. If R(T) n M7) = {Oy}, then F = R{T) ® N(T). 

4.6 THE SPACE/. (a V) 

SUM OF TWO LINEAR MAPS 

Let T: U ->■ y and S : U -*■ V be two linear transformations. Con- 
sider the map M : U -> V defined by 

M(u) = S(u) + 7(«) for all u e U. 

We shall prove that M is linear, that is, 

M(ui + «*) = MM + MM 

and M(<xui) = (xMM , 

for al* Ui, U 2 G U and all scalars a . 

We have 

M{ui t- Wa) = S(Ui Kg) + 7 (Kx + «i) (definition of M) 
= (S(K,) -I- S(K,)) -f (7 (Kj) -f 7X«a)) . 

because S and 7 are linear maps. On the other hand, 

MM -1- MM ^ iSM + tM) + (5(«a) + r(Ka)) 

(definition of M) 

= (SM + SM) + (TM + TM) 

by associativity and commutativity of addition in F. Thus, 

M(ui + Kg) = A/(Hj) 4- A/(Kg) for alt k^. Kg £ U. 

Again, MiM == S(«Ki) + 7(aKi) (definition of M) 

= a(S(Kj)) + ol{TM) (^* T are linear) 

= a(S(K,) + TM) 

by properties of scalar multiplication in F. Thus, M(aKg) — aM(M for 
all UiG U and all scalars a. This proves that Af is a linear map. 

The map M defined above is called the sum of S and T and is denoted 
by S + T. Thus, 

(S + 7)tK) = M{u) = S(u) -1- 7(k) for all u € U. (I) 
We have thus shown that the sum of two linear maps is linear. 

SCALAR MULTIPLE OF A LINEAR MAP 

Let 5 : U -»■ F be a linear map and a a given scalar. Note that V and 
F are vector spaces over the same field of scalars, and a also belongs to 
the same field. Consider the map P: U -*■ V defined by * 

P(u) « a(S(K)) for all K e U. 

We shall prove that P is linear, 
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Let U|, u, be two elements of U and X be a scalar. Then 

H-h 4 «») = 4- «»)) (definition of P) 

= a(5(«j) + S[Ut)) (S is linear) 

= a.(S(Ui)) -f a(<S(u2)) (K is a vector space) 
= P{Ui) 4- P{ut) (definition of P). 

Again, 

PQUi) = a(5(XMi)) (definition of P) • 

= a{X(S(iij)j) (S is linear) 

= X(^(iS(«i))) . (K is a vector space) 

= x(iX«i)) for each scalar X (definition of P), 
This proves that P is a linear map. 

The map P defined above is called the scalar multiple of S by a. and is 
denoted by a.S. Thus, 

(«S)(tt) -- P(«) = «(S(ii)) for all ue U. (2) 

Thus, the scalar multiple of a linear map is linear. 

Example 4.27 Let T : K, -> K, and S : Kj -► K* be two linear maps 
defined by 

T\XYf jCj, X3) *= (X| x^f x^ 4“ ^3) 

and S(Xt, x,. X3) = (2x„ x, - X3) . 

Then (5 4- : ^3 K, is given by 

(S 4" T)(Xj,.X 3, X3) = ^(X|, X3, X3) -f T\xi, X3, X3) 

= (x, — x„ X, 4- Jfs) 4- (2*1, *3 — *») 

= (3xi — x„ 2x3) ; 
and aS ; Pj, ->■ F, is given by 

(aS’)(xi, *2, X,) = «(S(X2, X2, X3)) 

== »(xi - x„ X, 4- X,) 

= («Xi — axj, ax, 4- ax,) . 

Example 4,28 Let T : K, F, and S : F, -> F, be two linear maps 
defined by 

r(ei) = Cl + e,, r(e2) = c,, r(e,) = e, — e,; 
and Siefi = e„ S(e,) = 2e, - e„ S(e,) = 0. 

Then S 4- T : F, -»• F, is given by 

(S 4- T)(efi = 4- e, 4- ^3 , 

(5 4- T\{e^) = 5(e,) 4- IXe.) = 2e, . 

{S 4- r)(e,) = 5(e,) 4- T{t^ = 
and 2r : F, -► F, is given by 

(2r)(ei) - 2(7T(ei)) = 4- 2«, , 

me^ ^ 2(2Te,)) « 2e, , 

(221(e,) = 2(7Xe,)) = 2e, - 2«, . 

The set of ail linear transformations from Cf to K is denoted by L(U, F). 
We now have three different objects befine us (see Figure 4.2), namely, 
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(i) the vector space U, 

(ii) the vector space K, and 

(iii) the set L(U,'V), whose elements are linear maps T:U V. 

The sum of two linear maps and the scalar multiple of a linear map of 
the foregoing discussion give us the operations of addition and scalar 
multiplication in L{U, V). Our claim is that L{U, F) is a vector space for 
this addition and scalar multiplication. 



Since the sum of two linear transformations is a linear transformation 
and the scalar multiple of a linear transformation is linear, we have only 
to check axiom (VS3). First note that HU, V) is a commutative group 
for addition. The zero map 0: U V, defined by 0(«) - for all 
M £ IS in L(U, V) (see Example 4 4) and plays the role of identity for 
addition in L(U, V). The map (—S):U->y is defined by (— 

= — (S(u)) for all u & U. It is easily seen that (- 5) G HU, V) and 

-5 - (-l)S. 

Further, if S and T arc two members of L(U, V) and «, p two scalars, 
then 

(i) a(S + r) = aS + «r, 

(ii) (« + P)S = a5 + pS, 

(iii) «(PS) = («P)S == P(«S)f 

(iv) IS = S. 

We shall leave it to the reader to verify these axioms. Once they are 
verified, we will have proved the following theorems 

4.6.1 Theorem The set UU, V) cf all linear tran>formatiotu from U to V 
together vHth the operations of addition and scalar nadtipUeatlon 
defined In Statements (i) md (iO is a vector space. ■ 

4.6.2 Remark It should be noted that F) is a ical vector space if 
both U and V are real vcotor spaces, and it is a complex vector.space 
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if both U and V are complex vector spaces. 

We shall prove in Chapter S that if U and V are finite-dimensional 
vector spaces, then dim L(V, V) — dim V x dim V. 

Problem Set 4.6 

1. Let the linear maps 7* : F, -> F, and 5 : F, -»■ F, be defined by 

T(Xt, jcJ = (xi -f- 0 ), 

Sixu x^ = (2xi, 3x, + 4x,). 

Determine the linear maps 
(a) 25 + 37 (b) 35 - IT. 

2. Let the linear maps r : F 3 -»• Fa and 5 : F, Fj be defined by 

71(xi, X 2 , x^ ( 2 X 2 3x2, " 1 " 

5(ei) = Cj - Ca. S(et) = Cj, 5(e,) = + e, 4 fg. 

Determine the linear maps 
(a) 5 4 7’ (b) 35 - 27 fc) a5 

and find their values at (Xj, X 2 , x,). 

3. Let the linear maps R, 5, and 7 be defined as in Problem I , § 4.4. 
Then find the linear maps 

(a) Jl 4 25 (b) 2il 4 57 (c) 5 - 7 

(d) il 4 S + 27 (e) ail 4 PS + yT. 

4. Prove that the set of all linea| maps from Fj to F, which map the 
vectors on the line x 4 y = .0 onto the origin is a subspace of 
L(F„ F 2 ). 

5. Let CA be a subspace of a vector space F. Then prove that the set of 
all lipear transformations from F to F that vanish on C/ is a subspace 
ofL(F, F). 

6 . Let 7 : Fi -»■ Fj be a nonzero linear transformation. Then prove 
that L(F 2 , Fj) = [7]. 

7. Determine two linear transformations 7 and 5 of rank 4 from F 4 to 
F 4 such that 

(a) r(7 4 5) = 3 (b) r(7- 5) = 2 

(c) r{T 4 25) - 1 (d) r(7 - 5) = 0. 

8 . Prove Theorem 4.6.1. 

9. If 5 and 7 belong to L(U, V), then prove that 5 0 7 € L(U, U). 

10. True or false? 

(a) To prove a(5 4 7) = a5 4 »7, where 5 and 7 are linear maps 
from U to F, it is enough to prove that 5 4 7 is linear. 

(b) HU, R) is a proper subset of tfjfHV). 

(c) If 5, 7 : -> F are linear, then 5 — 7 is linear. 
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(d) For a linear map S, S(u) = 5(— «). 

(e) rae.UU,V). 

(0 Rank of (S + T) = rank of S + rank of T. 

(g) Rank of (a5) — a rank of S. 

4.7 COMPOSITION OF LINEAR MAPS 

Let T :U -> V and S : K -> IF be two linear maps. We know that the 
composition S o T: U -> ff'is defined by 

S 0 r(u) = S(7Xu)) for all « e (Definition 1.7.2). 

S 0 T T S 

Symbolically, U > W=U-*vU-W. 

This map is linear, because with the usual terminology 

S 0 T(ui + i/jj) = ^(r(«x + «i)) (definition of composition) 

= S(T(ui) + r(«*)) (T is linear) 

= S(T(ut^) + SiT(Ui)) (S IS linear) 

— (So T)(Uj) + (S o T)(Ug) (definition of 

composition) 

for all «i, M* G £/. 

Again, (S o T)((xui) = S(T((xui)) (definition of composition) 

= S((x(T(Ui))) (T is linear) 

= a(S(r(«i))) (S is linear) 

= a(S o T)(ui) (definition of composition) 

for all Ux £ 1/ and all scalars a. 

Thus, the composition of two linear maps is a linear map. 

Example 4.29 Let a linear map T : F, -> F4 be defined by 

r(cx) = (1, 1, 0, 0), r(e*) = (1^ -1, 1, 0), r(e,) = (0, -1, 1, 1), 

where {e^, e^, e,} is the standard basis for F„ and let a linear map 
S : F4 -> F, be defined by 

S(/i) = (l,0), S(/,) = (I, 1), 5(/3) = (1. -1), S(/4) = (0, 1), 
where « the standard basis for F*. Then the linear map 

S o r ; Fj -> Fj is obtained as follows (see Figure 4,3) ; 

(S 0 70(er) = S(2T(ex)) = 5(1, 1, 0, 0) = S(/x +/,) 

= 5(/i) + 5(/,) = (1, 0) + (1, 1) = (2, 1) , 

{S 0 r)(e,) = 5(7Xea)) * 5(1, -1, 1, 0) = S(/x -/»+/,) 

= 5(/x)-S(/,)+^(/,) 

= (1, 0) - (1, 1) + (1. -1) = (1, -2) , 

(S 0 r)(e,) = S(7Xe,)) - S(0, -1, 1. 1) = 5(-r/, + /, +/«) 

« -5(/,) + Sif^ + S(/4) 

-(1. 1) + (I, -1) + (0, 1) « (0, -1) . 
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We shall hereafter use ST for S o r and call it the product of S and T, 
rather than the composition of S and T. 

We know that if ST is defined, then TS need not be defined. Even if 
both are defined, they need nut be equal. Thus, the commutative law of 
the product is not in general satisfied. The other laws of multiplication 
are easily seen to hold. 


SoT 



4.7.1 Theorem Let T,, T, be linear maps from U to V. Let Si, S, be 
linear maps from V to fV. Let Pbe a linear map from W to Z, where 
U, V, W, and Z are vector spaces over the same field of scalars. Then 


(a) Si(Ti + r.) = SiTi + SiT, . 

(b) {Si + Si)Ti = SiTi + SJ-i . 

(c) P(SiTi) == (PSi)Ti . 

(d) {»Si)Ti = *(iS'i7\) = SfotTi), where a is a scalar. 

(e) IvTi == Ti and Tilu = Ti . 


Proof : (a) Tj + T, : £/ -► K and Si'. V-*-W are linear. The pro- 
ducts Si{Ti + Tf) and SiTu SiT, are defined. So both sides of (a) make 
sense. Now, if « is a vector of U, then 


(SiiTi -i- r,))(«) = SiiiTi -t- r,)(«)) 

= Si{Ti{u) + r,(«)) 

* 5,(r,(«)) + SiiTM) 
= iSiT^Hu) + (5,ro(«) 
= iSiTi -i- SiT,Xu) 


(definition of product) 
(definition of addition 
in UV, V)) 

{Si is linear) 
(definition of product) 
(definition of addition 
in ^U. V)). 


Hence, 

+ r.) - SiTi -i- SiT, . 

The proofs of the remaining phrts are left to die reader. | 
Note spjeciaOy the diagram for part (e) Theorem 4.7.1 : 
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Ti iv r, 

u ► V — > U — ► V 

lu T, r, 

u - .[I— ^v^u-~-^v. 

LetTrlZ-vKhea nonsmguUr linear map, i e T is linear, one-one, 
an^ onto. Then we know that r-‘ :V-*-V exists and is linear (Theorem 
4.4.3). Further, 7T ^ — Iv and T-^T -- lu (ct § 1 .7). In fact, this 
characterises nonsingularity as shown in the following theorem 

4.7.2 Theorem A linear map T'.V is nonsingular iff there exists a 
linear map SxV -f V such that TS = ly and ST ~ /y. 

In such a case S = T-^ and T = S-\ 

Proof : Let T be nonsingular. The existence of S, namely, T-*, 
follows from the observations made immediately before the theorem. 

Conversely, let S and T exist with the properties stated, i e. JS = Iv 
and ST = lu. 

Let u € N(T). Then T(u) — 0 and consequently SlT{u)) — 0 But 
S(r(«)) = /o(ii) = «. Therefore, m = 0. So N{T) is the zero subspace 
of U. Hence, T is one-one. 

Now let V G K. Then r(S(v)) — (TSKv) = h{v) = v Therefore, 
there exists an element u = S(y) in U such that T(u) — v. Hence, T is 
onto. Thus, T is nonsingular. Therefore, T-^ exists by Fact 44.2. 
Further, using Theorem 4.7.1, we get 

r -i = T-Hiv) = T-\TS) = (r->70S = /oS = S . 

Similarly, T = S-^. | 

Finally, we prove the following interesting theorem. 

4.7.3 Theorem Let T: U -*-V and S :V -*■ W be two linear maps Then 

(a) If S and T are non singular, then ST is nonsingular and 

(ST)-^ = T-^S-\ 

(b) If ST is one^one, then T is one-one. 

(c) If ST is onto, then S is onto. 

(d) If ST is nonsingular, then T is one-one and S is onto. 

(e) ffV,V,W are of the same finite dimension and ST is nonsingular, 
then both S and T are nonsingular. 

Proof : (a) Since 5 is nonsingular, S-'^ is defined and SS-^^ = 
and S-‘*-S Iv- 

Since T is nonsingular, T-^ is defined and 77^^ « Iv and T-^T ly. 
By virtue of (c) and (e) of Theorem 4.7.1, we have 
(S7XT-*S^) » S(T(T^S-*)) » S(( 
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Similarly, 

(T-^s i)(sr) = T-\s-\sr)) = t-\(s-^s)T) 

= T-HlyT) = T-^T =* Iv. 

Hence, by Theorem 4.7.2, ST is nonsingular and (ST)-^ = T-^S"^. 

(b) Let « G N(T}. Then r(M) = Or- So S(T(u)) = Oir, i.e. (STX«) 
=s Og,. But ST is one-one. Therefore, u — Of/, i.e. N{T) = {Oy}. Thus, 
T is one-one. 

(c) Let »r G Since ST is onto, there exists a vector u^V such 
that (S’r)(M) = w. Therefore, S(T(u)) = w. Hence, there exists a vector 
K = T{u) G V such that S(v) = iv. Thus, S is onto. 

The proofs of (d) and (e) are left to the reader. | 

Notations (a) The set of all linear operators on U is denoted by L(,U). 
(b) If r is a linear transformation on U, then the composition TT is also 
denoted by T^. Similarly, T*- = T'‘~^T for any positive integer k. By 
convention, 'H = I. 

Problem Set 4.7 

1. Let T : F 3 -V Ks be defined by r(x„ Xg, Xj) = (xj -t x* -f Xg, x,) 

and 5 : Kj be defined by S(Xi, x*) (x*, x,). Then determine 

ST. 

2. Let S and T be as in Problem 1, § 4.6. Determine 

(a) ST (b) TS (c) (d) T^S. 

3. Let S and 7 be as in Problem 2, § 4.6. Determine 

(a) ST (b) TS (c) STS (d) TST. 

4. Let S, 5, T be as in Problem 1 , § 4.4. Determine 

(a) ST (b) RT (c) RST (d) R(S + T) (e) 7* 
(0 T^ST. Also verify that R(,S + T) = RS + RT. 

5. Determine two linear transformations S and 7 on such that ST 

= T'S # 

6 . Let S and 7 be two linear maps on U such that ST = TS. Then 
prove that 

(a) (S -i- 70* = 5* -f 2(570 + 7* 

(b) (5 -h 7)» = 5» -f «c,5"-*7 -f ... -f ncj^. 

(Hint : Use induction.) 

7. Let F be a 1-dimensional vector space and S, 7 two linear maps on 

V. Then prove that ST = TS. 

8 . Let 7 be a linear map on a 1-dimensional vector space V. Then 
prove that 7* = aT for some fixed scalar «. 

9. Find the range, kernd, rank, and nullity of the following linear 
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maps, where R, S, T are as in Problem 1 of Problem Set 4.4 : 

(a) RS (b) RT (c) RST. 

10. Let r be a linear map on a finite-dimensional vector space V. Then 
prove that 

(a) R{T) n N(T) =-- {0} iff r jc = 0 Tjc 0 

(b) If r{T^) = r{T), then R(T) O NiT) = {0}. 

11. If a linear transformation T on K satisfies the condition 7** + / = 7, 
then prove that T-^ exists. 

12. Let r be a linear map on defined by T{e^ = Cg, T{e^ — 
T{e^ — eg. Then prove that — T 

1 3. Let T : U V and S : V -> fV be two linear maps. Then prove that 

(a) If T is onto, then r{ST) = r(S} 

(b) If S is one-one, then r(ST) — ht). 

14. A linear transformation 7 on a vector space V is said to be idempo- 
tent if 7- = 7. For example, the zero transformation and the 
identity transformation are idempotent. 

(a) Let S and 7 be two linear maps on Fg defined as 

7(jrj, Xg, Xj) = (0, Xg, Xg) 

5(xi, Xg, Xg) - (x„ 0, 0) , 

Then prove that both S and 7 are idempotent. 

(b) If and Sg are idempotent on a vector space V, then find the 
conditions under which SiS^ and Si 4- arc idempotent. 

(c) If S IS idempotent on a vector space V, then / — 5 is al-o 
idempotent on V. 

(d) Determine two idempotent transformations S and 7 on a vector 
space V such that 57 — TS — 0, but neither 5 -- 0 nor 7—0. 

(c) If 7 IS an idempotent transformation on V, then prove that 
7V(7) ^ Ril-T) and R{T} = N(/ - T) . 

15. A linear transformation 7 on a vector space V is said to be nilpotent 
on F if 7" = 0 for some integer « > 1 , and the smallest such integer 
V is called the degree of nilpotence of 7. 

(a) Prove that the differential operator D is nilpotent on What 
is the degree of nilpotence of D ? 

(b) Is Z>’ -1- nilpotent on £?« ? If yes, find its degree of nilpo- 
tence. 

(c) Let 7 : F* -> Fg be defined by 

JXXg, Xj, Xg. Xg) — (0, Xj, Xg, Xg) . 

Is 7 nilpotent ? 
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(d) Ut r : K, K, be defined by 

^^3) =* 2 fj -f" 3e3. 

Is T nilpotent ? 

(e) If S and T are nilpotent transformations on a vector space V 
and ST -- TS, then prove that ST is nilpotent on V. What is 
the degree of nilpotence of STl 

What can you say about the nilpotence of 5 + 7 ? 

16. Let r : ^ K* be defined by 

7T[*i, X*, X 3 , X4) = (0, 2 xi, 3xi + 2 x„ jf* + 4jf,) . 

Then prove that 

(a) T is nilpotent of degree 4 

(b) For a nonzero scalar \ I -f- XT' is nonsingular and (7 4 XT)"^ 

■- '= / — XT 4- X®r' — \* 7 ^. In particular, 7 4-7 and 7 - 7 are 
nonsingular. 

17. Let 7 : ^“4 be defined by 

7(«3 4 «iJf 4- «3-** 4- «3^*) — (»o 4 2aj)A* -t- (*1 4 . 

Then prove that 

(a) 7 is nilpotent gf degree 3 

(b) For a nonzero scalar A, / 4- xr is nonsingular. Find its inverse. 

18. True or false? 

(a) \( S \U V,T '.V W are linear, then 

(7oSK««)-((«r)o(«.S)X«). 

(b) 7(S(««)) = (x7)(5(«)). 

(c) If S is one-one, then TS is one-one. 

(d) Every idempotent operator is nonsingular. 

(e) A nilpotent operator can never be nonsingular. 

(0 7® = 7 -> 7-® = (7^*)*, if T ' exists. 

(g) ifr is idempotent, then T* — T for all positive integers k. 

(h) If S : 1/ -► V and T: V-*-U are linear and TS = lu, then 
S = 7-*. 

(i) If Jt, S, 7 are three linear transformations such that SST is 
defined and is one- one, then 7 is one-one. 

4.8 OPERATOR EQUATIONS 

Let 7 : Cr K be a linear map from .the vector space V to the vector 
space V. In this article we shall discuss the solutions of the equation 

IX«) “ »o . (1) 

where v, is a fixed vector in V, Equation (1 ) is called an operator eqwUton. 



4.8 OKRATOR EQUATIONS / 139 

It is said to be homogeneous if i>o - Or. The set of solutions of the 
equation 

T{u) = Or (2) 

is simply the kernel of T, i.e. iV(r). If the equation is not homogeneous, 
i.e. Vj -j* Or in Equation (1), then (1) is called the nonhomogcneous (NH) 
equation and (2) the homogeneous (H) equation associated with ( I ) In 
this connection we have the following theorem. 

4.8.1 Thecrcm Let T : V -* V be a linear map Given V Of in V, the 
nonhomogeneous equation 

(NH) T(u) = Vo 

and the associated homogeneous equation 
(H) nu) - Or 

have the following properties ; 

(a) Ifv^^ then (NH) has no solution for u. 

(b) If v^E. R{T) and (H) has the Hvial solution, namely, u — Oi/, <ts 
its only solution, then (NH) has a unique solution. 

(c) If ^0 J?(T) and{H) has a nontrivial solution, luiiiu ly, a solution 

u Ou, then (NH) has an infinite number of solutions. In this case 

if Ug is a solution o/‘(NH), then the stt of all solutions of (NH) is 
the I kear variety Uo + K, where K ~ .V( f) is the set of oil 
solutions of (H). 

Proof : (a) is obvious. Recall the definition of /((O- 
(b) If >0 G R(T}, then TYm) v„ has a solution. It l(u) = Or 

has only one solution, i.e. u — Oy, then N{T) ~ {Ot,'}, i c. T is one-one. 

This means T{u) — Vj cannot have more than one solution, i.e. the 
solution of (NH) is unique. 

• . (c) If T(u) -- Or has a nonzero solution, then Af(7’) ^ {0(/}. Let 

Wo G U he & solution of(NH). It exists because Vg G Ii{T). Then T[Uo) 

— Vq. Now if w» G then 

TYwp + «») T(uo) I TM 
= Vo 4- Or = I'o . 

Therefore, Uo I- w» is a solution of (NH). This is true for every 
w* € ■N(r), and since the latter has an infinite number of elements in it, 
(NH) also has an infinite number of solutions. 

From this discussion it is obvious that Wg -1- it, where K == N(T), is 
contained in the solution set of (NH). Conversely, if w be any other 
solution of (NH), then 

TXw) = Vg « r(w,) 

or IXw — Ug) *3 Or . 

This me a"« w — G N(T) ^ K. So w and w, belong to the same 
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parallel of K, namely, Ug + K. Thus, the soJution set of (NH) is jmcisely 

Uo + K.% 

Note that u,, + /Cis the T-pre-image of Vf 
Example 4.30 Let D ; ^^<**(0, 23t) -> ^-'(0, 2n) be the linear differential 
operator. Consider the operator equation 

D(fXx) = sin X . 

To solve this, we look at the associated homogeneous equation 
(H) JD/=0. 

The solution set of this equation is the set of all constant functions. So 
K = {f\ f(x) == b for all x G (0, 2it) and b a constant} . 

One solution of D{f}(x) = sin x is the function /„ where yi(x) 
= — cos X. So the solution set is 

fo + K. 

In other words, the set of all functions g, where g{x) = — cos jc 4- (a 
constant) is the solution set of D(f)(x) ~ sin x. 

To solve a nonhomogeneous operator equation 
(NH) r(«) = Vo . 

where J is a linear operator, we go through three steps : 

Step 1 Form the associated homogeneous equation (H). 

Step 2 Get all solutions of (H). It is the kernel of T, i.e. N(T). 

Step 3 Get one particular solution Ug of (NH). 

Now the complete solution of (NH) is Ug + JV(T). 

Exmnple 4.31 Let T : F, -> K* be a linear map defined by 
ne,) = i/i, T{eg) = iA. TXe.) =/., 

T(e«) = A. ne^ = 0. 

where (cj, c*, e^, e*, e,} is the standard basis for Vg and (A. /a. A) the 

standard basis for K,. Then solve the equation 

m = ( 1 . 1 , 0 ) . 

We first calculate the value of T{u), i.e. T{xi, Xg, x„ Xg, x,) : 

TXxi, Xg, x„ Xg, X,) = XiT(ei) + x*r(e,) + XgT(e^ + XgTXe^ 

+ XgTie^ = ( . X, + Xg. 0) . 

The associated homogeneous equation leads to the equations 


Solving these, we get x* = — Xj, x, = — Xg. Thus, the kernel of Tis the 
set of all vectors of the form (xi, — Xi, x,, — Xj, x,), i.e. Xi(l, —1, 0, 0, 0) 
4- x,(0, 0, 1, —1, 0) 4- 0, 0, 0, 1). Hence, 

W) - [«. -1. 0, 0, 0), (0. 0, I, -I, 0), (0. 0, 0, 0, 1)J . 
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One particular solution of !(«) = (1, 1, 0) is m, =■- (2,0, 1,0,0), 
which is obtained by putting atj - 2, ;r2 --- 0, =- I. ~ o’, = o! 

So the complete solution of the equation 

nu)-~ ( 1 , 1 , 0 ) 

is the linear variety (2, 0, 1, 0, 0) 1 - JV(7), i.e. the set 

(2, 0, 1, 0, 0) -j- {(a, —a, b, —b, c) \ a,b, c arc real numbers} , 
which is the same as 

{(a 2, — a, 6 1, —b, c) | a, c are real numbers} . 

In other words, the J-pre-image of (1, 1,0) is this linear variety. 

Problem Set 4.8 

1 . Determine the range, kernel, and the pre-image of (3, 1 , 1) for the 

linear transformations R, S, T of Prob'em 1, Problem Set 4.4. 

2. Find the T’-pre-image of (1, 2, 3) under the linear transformations T 
defined in (b) through (e) of Problem 1 Problem Set 4.2. 

3. Find the T’-pre-image of the following two vetiors under the linear 
transformation defined in (h) through (I) of Problem 1, Problem 
Set 4.2 : 

(a) X (b) .v^ 


4.9 APPLICATIONS TO THE THEORY OF ORDINARY 
LINEAR DIFFERENTIAL EQUATIONS 


In this article we propose to appl> the theory of operator equations to 
the important opentor equation in mathem.itics, namely, the linear ordi- 
nary differentihl equation. For this we shall develop the theory of 
ordinary linear differential equation, using the necessary concepts from 
linear algebra. 

The simplest linear ordinary dififerential equation of the first order is of 
the form 

a^ix) ai{x)y - gix ) , ( 1 ) 


where a^ix), ai(x), and g(A') arc continuous on an interval /. If a^ix) is 
nowhere zero in /, then Equation (I) is called a normal linear differential 
equation of first order. If Equation (I) is normal, we can conveniently 
write it in the form 


dy , ai(x) _ gix) 
dx Oo W " 


( 2 ) 


This is usually written as 




( 3 ) 
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where P and Q are continuous functions of x alone. We can rewrite it in 
operator form as 

(D + P)y=Q 

or 

Ly^Q, (4) 

where L stands for the operator D + P which is a linear operator from 
to ^(/). Since L is a linear operator, we can look at Equation (4) 

as an operator equation. Therefore, we can apply the results of § 4.8. In 
particular, we know that the general solution of Equation (4) consists of 
two parts. One part is the solution of the homogeneous equation 

(H) Ly^Ft 

and the other is a particular solution of 

(NH) Ly = Q. 

The general solution of (H), i.e. of 

^ + Py^o (5) 

is called the complementary function and is denoted by ye. A particular 
solution of (NH), i.e. of Equation (3) is called a particular integral and is 
denoted by yp. 

Therefore, the complete solution of Equation (3) is of the form 

y = ye + yp, (6) 

where ye is actually the kernel of L and yp is some particular solution of 
Equation (3). 

To solve Equation (3), we first find ye. We write Equation (5) in the 
differential form 

Pydx + dy^0 (7) 

or Pdx + — dy = 0 . 

y 

Integrating Equation (7), we get 

IPdx + In y = In C , (8) 

where C is an arbitrary constant. Equation (8) can also be written as 

y = ^ 

which is the required complementary function yc. Writing Equation (9) as 
yg\Pdt _ c, we find that it is the solution of 

i... +.'«'* -0. 

This gives the clue to the solution of Equation (3). We multiply both 
sides of Equation (3) by and get 
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which on integration gives 

= iQei^‘‘*dx . 

We are not interested in any arbitrary constant now, because we are 
looking for only one yp. So 

y^ = e-IPrf* iQe\f^ dx . 

Thus, the complete solution of Equation (3) is 

y = y^ + yp^ dx , (10) 

where C is an arbitrary constant. 

Example 4.32 = x. 

Here P => — Q = x, and JPdx = - / ^ dx 

-- - i In 1 **•— 1 I , 

So = e“* *" I I = 1/V^^ ~ 1 and — yjc* — 1. 

Thus, 

>'o = cv*® - 1 . 

i-P - =- - 1) . 

and the complete solution is y — yc -h yp. 

Example 4.33 

^ + Py = Qy*, n ¥■ I . (11) 


This equation is the well-known Bernoulli's equation. It is not linear, but 
it can be reduced to the linear form by the substitution 


^ = (1 - «)y- 


Equation (11) then becomes 

1 


\ — n dx 


^ + PY==Q. 


dy 
dx ' 


This is a linear differential equation and can be solved by the method of 
Example 4.32. 

Equation (10) represents a family of solutions (actually it is a linear 
variety). For each value of C, this is a curve in the xy-plane. If, in 
addition, we require a solution* that satisfies the condition y{x^ = y^, then 
the solution will be represented by a unique member of the family passing 
through (Xo, y^. The problem of finding a solution y = y(x) for Equation 
(3), which also satisfies the initial condition y(x^ = yot called an Inititd 
value problem for the normal first order linear differential equation. 

The foregoing discussion is summarised in the following theorem. 

4.9.1 Theorem Every initial value problem involving a normal first order 
ord nary I near differential elation has one and only one solution. 
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This is called an existence and uniqueness theorem — existence, because 
the theorem asserts that every initial value problem has a solution; unique- 
ness, because it further says that the solution is unique. 

Existence and uniqueness theorems are important in the theory of 
differential equations. Theorem 4 9.1 was easily provable. The corres- 
ponding theorem for the n-th order linear differential equation is beyond 
the scope of this book. However, we shall now state it (without proof), 
since we intend to use it in the theory that follows. 

4.9.2 Theorem Let 

‘di ‘ ^ ••• ■’ 

V 0, .r G / be a normal n-th order linear differential equation 
defined on an interval L Let be a fixed point in I. Let a,,, a^, 

ttn-i be n arbitrary real numbers. Then there exists one and only one 
solution of Equation (12) satisfying the initial conditions y^x^) aj,, 

~ a, 1. 

The problem of finding a solution of Equation (12) satisfying the initial 
conditions, listed in Theorem 4.9 2, is called an initial value pi ohlem {or 
the equation. 

This theorem is at the basis of all further theory of linear differential 
equations. It says that every initial value problem involving a normal 
w-th order linear differential equation has precisely one solution. We are 
now ready to state the main theorem of this article. 

4.9.3 Theorem Ihe solution space of any normal n-th order homogeneous 
linear ordinary differential equation 

lix’' ® 

Ooix) /■ 0, X G /, defined on an int. rval I is an n-dimensional sub- 
space of Y 

To prove this theorem, wc need the following lemmas. 

4.9.4 Lemma The solution space of Equation (13) is a subspa 'e of ^ *"*(/). 

Pioof : We need only to note that the differential operator 
L — affx)D^ -1- a,(A')D’'-‘ + ... -1 a,Xx) is a linear operator from '/f' "’(/) 
to (/), and so the solution space of Equation (13) is the kernel of L. 

Therefore, it is a subspace of Y 

4.9.5 Lemma Let yi.yj, be n functions in Yj "*’(/) and x^ a fixed 

point in I. If the vectors v,(jfo) = (y,(x^), y',(xo) y,*"' ”(* 0 )). 

i =* 1, 2, ..., n ofVn are L», then y„ y*, ..., y„ are Li over /, 

Proof : To prove that y,, y*, ..., y„ are Li over I, assume 

+ c*)'*(Jf) + ... + c,^y„(jc) a. 0 for alU G /. (14) 
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The assertion is proved if we can show that Equation (14) holds only 
when Cl = C} = ... = c„ = 0. 

Differentiating Equation (14) successively (k — 1) times, which is 
justified because yi(jc), y*(jf), ..., >>„(*) belong to '^'^‘•*(/), we get the 
following equations : 

+ c^ytix) + Cny«{x) = 0 , 

+ cty'gix) + ... + Cf^'nix) = 0 , 

f ^ Ciyg<"-‘>(4 + .. + = 0 f 

for all Jf G /. Thus, for Xo G /, we obtain 

+- CiVsW - 4 Cnynixo) = 0 , 

ClP'iW^o) + fiy'iiXo) + ... + CBV«(-*fo) = 0 . 

Ciyi<"-‘>{Xo) + C3yij'"-‘*(Xo) + . . + Cny„‘" "(Jf*) = 0 , 

which IS equivalent to 

• f Cn(>’n(jro), y»(^o). = 0 . 

In other words, CiVi(xo) 1 CiVi(Xo) + ... f CnV»(xo) = 0 . Since v,(x#), 
i - 1, 2, , « are Li in K„, all the scalars c,, c*. , c„ are zero. Hence, 

yi. yj. .. , y« are LI over I. | 

Proof of Theorem 4.9.3 By Lemma 4.9.4, the solution space of 
Equation (13), denoted by K, is a subspace of ^ '"’(/). We shall now prove 
that dim K — n. 

Let X, be a fixed point in I. Then, by the existence and uniqueness 
theorem, there exists a unique solution yi satisfying the initial conditions 

yi(jfo) = i.y'iW = o,y5;(xo) = o, .. ,yi'"-‘’(xo) = o. 

Similarly, there exist unique solutions y 3 ,y 3 , .. ,y„ satisfying respectively 
the initial conditions 

y^ix^ = 0,y2(x3) .= 1, yj(xo) ^ 0, ..., yg’^'^K^o) = 0 ; 
yaUo) — 0,/*(Xo) = 0, y;(x,) •= 1, •• ,y3‘"-"(Xo) = 0 ; 


yn(Jfo) = 0,y;;(Xo) = 0, y^(xo) ■=- 0 y«’“ ”(Xo) = 1 . 

From this it is obvious that (y,(xo), y,'(xo), ..., yt’""^’Uo)). * = 1.2, 
..., n, are the vectors Cj, c*, .. , c„ of V^. Therefore, the vectors (y<(x,), 
yi(*o). ■.•.y.'"-”(JCo)). 1 = 1.2, ••, n, are li in K„. Hence, by Lemma 
4.9.5. yi, yt , .... y* are li over /. 

We shall complete the proof of the theorem by showing that the 
solutions yi, y^, .... y^ generate the space K. 

Let y be an element of K, satisfying the initial conditions 

y(jc«) = «i.y'(JCo) = «t. .•My‘"“^*(*o) = 

Consider the function -f ? 4 y* + ... 4’ »iiy»- Th'* ** clearly a solution 
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of Equation (13) satisfying the said initial conditions. Hence, by the 
uniqueness part of Theorem 4.9.2, y = + ... + ttny»’ So y G [yi, 

ya y«]- 

Thus, the set {vi, yt, — .yn) <s u and spans K, which means that the 
set {yi, y,, .... ynl is a basis for K. Hence, dim K = n. 

From Theorem 4.9.3, the following corollary is obvious. 

4.9.6 Corollary If yi, y*, .... yn ore n linearly independent solutions of 
Equation (13), then any solution of Equation (13) can be written as 
Ciy\ + Cjyj -f- ... + Cfly». 

In Theorem 4.9.3 and Corollary 4.9.6 we have discussed in detail 
the solution of the homogeneous normal linear differential equation 
Ly = 0, where L = a^(x)D^ + ai(x)D^^ + ... + + a«(.x). We 

now consider the nonhomogeneous equation 

= (15) 

Since L is a linear operator from ‘"*(/) to 0 (I), Equation (15) can be 
considered as an operator equation. Hence, by Theorem 4.8.1, the 
general solution of Equation (IS) is the L>pre-image of g. It is the linear 
variety yp + yc, where yp-is a particular solution of Equation (15) and yc 
is the kernel of L. We summarise this result in the form of a theorem. 

4.9.7 Theorem Let 

Oo(-*) + Oi(x) + ... + a«(jc)y g(^) ( 16 ) 

be a nonhomogeneous normal linear differential equation on an interval 
/. Then the set S of all solutions of Equation (16) is a linear variety 
S = yv + yc in where the leader yj^ is any one solution of the 

equation and yc is the set of all solutions of the associated homogeneous 
equation. 


Problem Set 4.9 

1. Solve the following differential equations : 

(a) % -y = (b) * + y = cos » 

(c) (4-3v) ^ ~ 5y - X*l(3x - 4)*'» (d) + «y * 

(e) (Jc + 2y») ^ » y (f) « «x + Py + 8 

(g) (tan‘*y ~ “ 1 + / (h) sec y die — (x+cos y)dy *« 0 

(i) (y* ~ l)<ix + (2x -y* + l)dy - 0 

(j) oosy<£ic+(x8iny — l)d^ «• 9 
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(k) (k’+l)^ 


+ 2xy = sin X + xc* + ac® 


2 . 


3. 


fl) + + ^ = 

Solve the following differential equations : 


(a) (l+:c*) 


dy 

YV — 


(b) 


dy 


— x^y^ — xy 


dx ' "" dx 

(d) e^dx = x(2x>' + e'>)dy 
(c) cos y dx + x(x — sin y)dy — 0. 


(c) + y^e = xy 


In each of the following differential equations, verify that the given 
functions are solutions. Determine whether they are li and whether 
they form a basis for the solution space. 

(a) 

(b) 

(c) 

(d) 


y" + ^y' -1- == 0; c*®*, on (— 00 , 00 ). 

y"' — 4y' = 0; c®*, e"®* on ( — x, co). 

x^y" “ 2xy' 1 2>' — 0; 2ji:® —x, x® f 2x, x® on (- co, x). 

y"' - y" -'2y' — 0; t>-*, sinh x — e'/2, 2<’®’', 1 on ( - 00 , x). 

1 - x| 


(e) y’ — 2xy7(l — x®) — 0; I — lanh"‘x, 1 + In 

(- 1 . 1 ). 


I+aI’ 


2 on 


(f) (D* - 4/)® ^ 7D- -iD-r 2)y = 0; ve» «*( 1 - sin x), 
€* cos X, e*{sin x — x) on (— x, x). 

(g) (x®D* + 3xD + l)y = 0; 1/x, In x/x on (0, x). 

(h' (xD® — D^)y -- 0; 1. X, x® on (0, x). 



Chapter 5 


Matrices 


Matrices form an important tool in the study of finite-dimensional 
vector spaces. Determinants form an important tool in the study of 
matrices. We shall study matrices in this chapter and determinants in the 
next. 

Hereafter, though for convenience we deal with real vectors and the 
leal vector space alt our arguments and definitions, unless otherwise 
restricted, wilt apply also to complex vectors and the complex vector space 


5.1 MATRIX ASSOCIATED WITH A LINEAR MAP 

For the theory of matrices, it is sometimes necessary to visualise 
vectors of Kp (any p-dimensional teal vector space is isomorphic to Kp) 
as coltimn vectors, i.e, a vector (*1, a^, «,) of V„ may be written in the 
form 

~ «i “1 

»» 


L «j, J 

where coordinates of the vector are written in a vertical column read from 
top to bottom. It may be noted that so far we have been writing this as 
a row vector, i.e. in a horizontal row from left to right. To save space, 
column vectors are also written as («i, aj, .... ap)f, where the letter T 
denotes that the vector is a column vector. (The appropriateness of the 
letter T will become clear later.) 

For example, the vectors Ci, Cj, and e^ of Vf may be written as 
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~ I n 


- 0 "1 


”01 

0 1 

> 

1 1 

, and 

0 

_ 0 _ 


_ 0 J 


L 1 J 


or as (1, 0, 0)^, (0, 1, 0)^, and (0, 0, l)’^. If v — 2«i - + e^, then 

the coordinate vector (2, — 3, 1) of v relative to the basis {e„ e.^, e^} can be 
written as 



or (2, -3, \)r. 


Before we discuss the general definition of a matrix, let us take a simple 
example : Let Bi = {«,, Mj} and - |Vj, v*, Vj, v,} be ordered bases 
of Kj and respectively. Let J : I's F* be a linear map defined by 


T(Ui) =- Vi - 2va + Vj - v* 

T(Ut) -= Vi Vj 1- 2v^ 

\ T(Ug) - Ivg + 3vj — Vt . 

Then the coordinate vectors (relative to B^) of r(Wi), Tiu^), and T(Ui), 
written as column vectors, are respectively 


r 11 


- 11 


r 0 1 

-2 

9 

-1 

, and 

2 

1 


0 


3 

L.~lJ 


r 

K> 

L 


L -1 - 


Everything about the linear map T is contained in these 3 x 4 = 12 
numbers, written as above. The arrangement of these 12 numbers in the 
form 

r 1 1 0“ 

-2 -1 2 
1 0 3 

_-l 2 -1_ 

is called the matrix of T relative to B^ and B^. 

We shall now give the general definition of a matrix. 

5.1.1 Definition Let U and V be vector spaces of dimensions n and m, 

respectively. Let = {«! and B* «*= {vi, .... v«,} be ordered 

bases of U and V, res^tively. Let T : U ->■ V be ' a linear map 
defined by r(ii,) = «x,Vi + «*»v* + ••• + J — 1. 2, . » so 

that the coordinate vector of T(u,) written as a column vector is 
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r*" 1 


L «»i J 

Write the coordinate vectors of T(u^, T{Ut), — , T{u,), .. , T{Un) 
successively as column vecto'^ in the form of a rectangular array as 
follows : 


"“11 

<tl2 ... 

*1, ... 

ami 

1 

aa, 

*22 

*2^ ... 

1 

*2» 

« 

• 

• 

• 

« 


1 


*7112 • • • 

a*«/ 

1 

*mn — 1 


This rectangular array is called the matrix of T relative to the 
ordered bases By and and is denoted by (T : Bi, B^). 

It may be noted that in this definition a,^ is the i th coordinate of T(Uj) 
relative to the basis (vj, vg, •• , v„}. 

5.1.2 Remark The numbers that constitute a matrix are called its entries. 
Each horizontal line of entries is called a row. Each vertical line of 
entries is called a column. The above matrix has m rows and n 
columns. The matrix is therefore called an *m x n’ (read as m by n) 
matrix. The order of the matrix is said to be ‘m x They-th 

column of the matrix is a column vector (a^,, and may 

be considered an element of Vm. The /-th row of the matrix is a row 
vector («,!> ■’ > and may be considered an element of 

The matrix is denoted, in short, by the symbol = i, . or 

7 n 

simply (ai,)mxn. is called the ij-th entry, and it is at the inter' 
section of the /-th row and the >th column. 

Example 5.1 Let a linear transformation T : Fg K, be defined by 
T{.Xu x%) (Xi + Xi, 2xi — Xt, 7xt). 

If Bi = {eg, eg} and £g = {/ufttA) are the standard bases of Kg and 
Kg, respectively, then 

Ties) =^A + 2/, -f O/g 
and r(cg) = /i — /* + 7/g . 

The coordinate vectors of T{ei) and Tie^) are respectively 


- 1 - 

r 1 

2 

and —1 

_ 0 J 

L 7 J 
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Therefore, the matrix of T relative to and S, is 

-1 in 
2 -1 . 

L_0 7_ 

Example 5.2 Let a linear map T : K, K, be defined by *,) 

“ (^1 x^ jfg, 2x^ “1“ 3^2 ^^3, Xi "I" X 2 2X3), 

If j5i = {Pi, eg, Cg), the standard basis, and Bg = {(1, 1, 0), (1, 2, 3), 
(-1, 0, 1)}. then T(ei) = (1, 2, 1) = 2(1, 1, 0) 4- 0(1, 2, 3) + 1(-1, 0, I). 
So the coordinate vector of T(ei) relative to Bg is (2, 0, 1). Similarly, the 
coordinate vectors of T(eg) and Tieg) relative to Bg are (6, — J/2, 11/2) and 
(0, —1/4, —5/4), respectively. Writing these successively as column 
vectors, we get the matrix of T relative to Bg and Bg as 

r2 6 0~1 

0 -f -i . 

LI V -}_ 

Example 5.3 Let a'1 inear map T : K3 -> Vg be defined by T{e^ = 2/^ 
-/*. T(eg) =/i + 2/j, T{eg) = O/j + 0/*, where {Ci, Cg, e^) and {/i, /*} 
are standard bases in Vg and Vg, respectively. Then the matrix of T 
relative to these bases is 

r 2 1 on 
I I- 

L-1 2 OJ 

Let us find the matrix of the same linear map T relative to some other 
bases, say Bg = {(1, I, 0), (1, 0, 1), (0, 1, 1)} and Bg = {(1, 1), (1, —1)}. 
We have 

T(Xi, Xg, Xg) = Xir(ej) + XgT(eg) + XgTieg) 

= (2xj + Xg)fi + (2x, - Xi)f, 

= (2xi + Xg, 2xg - Xi) . 

Therefore, TO, 1,0)= (3, 1) = 2(1, 1) + 1(1, -1) 

7(1, 0. 1) = (2, -1) = id. 1) + f(l, -1) 

T(0, 1. 1) = (1, 2) = 1(1, 1) - id, -1) . 

Hence, the matrix of T relative to Bg and Bg is 

r2 i n 

|. 

Ll f -iJ 

Note that the matrix of T changes when we change the bases. We 
shall pursue this matter in Chapter 7. 

Example 5.4 Let a linear map TiiPg-* Pg be defined by 7X«o + «rX + 
4- «,x*) = a, + (ot, + a3)x + («o + «i)x». Let us calculate the 
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matrix of T relative to the bases fli = {1, {x — 1), (x — 1)*, {x — 1)*} and 
B» — {1, X, X*} : 

r(i) = X* = 0 • i + Ox + lx® 
r((x - 1)) = 0 = 0 • I + Ox + Ox* 
r((x - l)®j = X - X® = 0 • I + lx - lx* 
r((x - 1)») - 1 - 2x + 2x* = I • 1 - 2x + 2x® . 
Hence, the matrix of T relative to and Bi is 

-00 0 1“ 

00 1 -2 . 

_1 0 -1 2 _ 


Example 5.5 Let D be the diflFerential map D(p) = p'. Let 

us calculate the matrix of D relative to the standard bases { I , x, x®, x®} and 
{1, X, X®} : 

D(l) ^0 = 0 . 1 -t Ox + Ox® 

0(x) =1 -- 1 • 1 + Ox f Ox® 

D(x*) = 2x = 0 • I f 2x + Ox* 

/)(x®) = 3x®-= 0 • 1 + Ox + 3x® . 

Hence, the matrix of D relative to the standard bases is 

roioo- 

0 0 2 0 . 

_0 0 0 3_ 


Example 5.6 We can easily check that the matrix of the identity map 
T:U -*-V (dim U = n) relative to a basis B{Bi = B^ — B) is the n x n 
matrix 


“I 0 
0 1 
• • 

_0 0 


0 ... 0 “ 

0 ... 0 


0 ... IJ 


( 1 ) 


This matrix is called the identity matrix and is denoted by In (or simply 
/, if n is understood). 

The i^th entry of this matrix is usually denoted by 5,„ where 6,^, called 
the Kronecker delta, is defined by 


So In ia the matrix {6,i)nx: 



if i^j 
if 


( 2 ) 


Example 5.7 Using the same procedure as in Example 5.6, we can check 
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that, whatever the bases used, the zero map 0 K, 
matrix 

rO 0 ... 0" 

0 0.0 

I 

LO 0 .. OJ 


FmWiIl have the 


(3) 


Each entry m this matrix is zero. This matrix is called the zero matrix 
of order m x n and is denoted by Omxn or simply 0 , if the order is under- 
stood. 


Problem Set 5 1 

In Problems I through 7 dcteimine the matrix (T . Bi, B^) for the given 
linear transfoimation T and the bases Bi and B^ 

1 . T: V,->V„T(x,y) = (x,~-y) 

(i) -= {(I, I),(l,-1)} 

(b) 5, - {(I, l),(l,0)}.i»* = {(2,3),(4,5)} 

2 r K, > V„T{x,y,z) - (Jt j,y4 z). 

(i) B, - {(I, 1, 1), (1,0,0), (I, ).0)},il*= 

(b) B, = {(1, 1, 1). (-1,2,- )), (2, 3, J)}, 5, - {( , 3), (i, 1)}. 

3. r : Kj -> Kj, T{\u Xi, x^, Xt) = (2a, + x^, -x^, x, + x,. r,, 

+ X* -1 3x, -f- X 4 ). 

B, = {(I, 2, 3, 1). (I, 0, 0, 1), tl, 1, 0. 0), (0, 1, •, 1)} 

Bi = {<>1, Ci, e^, e^, ej} 

4. D : 9., D(p) - p' 

jjj = = { 1 , x,x\ . ,A"}. 

5 T. 9^^9x, T{p)(x) = p'(t) dt. 

(a) B, = Bj =- {I, X, X*, X®, X®} 

(b) B, = {1, A, x®, X®, X®}, Bj = {x - 1, X + I, X* — X*, X® -f- X*, 

X* -f x}. 

6 . T: 9f^ 9%, T(p) = xp(x). 

(a) B, = {1, 1 -1- X, 1 — X -1- X®}, B* = {1,1+ X, X®, 2x — x®) 

(b) B, = {1, X, X*}, B, = {1 + X, (1 + x)*, (I + x)®, 1 -x). 

7. r : F? -»• Ff . T(zi, z,) = (z, + iz*, z, - izg). B, and Bj are stan- 
dard bases. 

8 . Determine, relative to the standard bases, the matrii; of each linear 
transformation T in Problems 1(a) through 1(g) of Problem Set 4.2. 

9 True or false ? 
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(a) Let T : -*• Vg be a linear map. Then the matrix of T relative 

to any pair of bases is of order 4x6. 

(b) When referred tb the standard basis, the matrix of the linear 
map r : V 2 -* K defined as (x, y) i— ► (*', y'), where x — 
x' cos 0 — y' sin 6 , y = x' sin 6 + y' cos 0 , is 

|~ cos 0 —sin on 

I !. 

L_sin 0 cos 0_J 

(c) The matrix of the identity map I(j : U -> U relative to any pair 
of bases is the identity matrix. 

“0 0 0 1 

(d) 10 0 I IS the matrix of the linear map T : Fj -> Kj 
LO 0 0 J 

defined by T{ei) = 0 , Tie^) = r{e^ — 0 relative to the 
standard bases. 

ro 0 in 

(e) I 0 0 j is the matrix of the linear map J : F, -»• F, defined 
LO 1 0 J 

by Cl — T{e^, Cj = T{yx), <*3 = T(c*) relative to the standard 
bases. 

(f) To every linear transformation there corresponds a unique 
matrix. 

5.2 LINEAR MAP ASSOCIATED WITH A MATRIX 

In § S.l we started with a linear map and then defined its matrix. 
However, in order to define a matrix, it is not necessary to start from a 
linear map. Matrices can be considered as entities in their own rights as 
the following definition will show. 

5.2.1 Definition Any rectangular array of numbers such as 


-Pu 

Pia ••• 

Pli — 

Pin 

P 21 

Pat ‘ 

P2i ••• 

• 

p2» 

Pu 

P<2 • 

P*/ ••• 

Pin 

1 — 
f *' 

Pmt ••• 

Pm/ 

Pmn 
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is called an //( x n motfix. If m ^ n, the matrix is called a sguore 
matrix. 

Two matrices A = and B — {P„)«xb are said to be equal, 

written as A == B, if ce,j = p,, for every i and J. 

All the statements in Remark 5.1.2 also apply to a general matrix as 
defined in Definition S.2.1. 

A matrix whose entries are all real (complex) numbers is called a real 
( omplex) matrix. 

As already mentioned, our discussions in this chapter deal with real 
vector spaces, i e. V„ and V„. Also, the matrices used will be real. 
However, all the discussions hold for complex matrices if the real vector 
spaces and arc replaced by the complex vector spaces FJ and F®. 

Let us start with a matrix B — (P„)mxn and ask whether we can find a 
linear transformation T: U V, where U and F are suitable vector 
spaces With ordered bases, say Bi and Bg, so that B = (T : Bi, B^). 

The answer to this question is yes, because the process of obtaining the 
matrix from a linear transformation (see Definition S.1.1) is reversible. 
Let us go through the steps of this reverse process. 

Let the matrix B = (p,,)mXB be given. Using this matrix B, we shall 
define a linear map S : U V, where U and F are vector spaces of 
dimensions n and m, respectively. 

Let Bi -= (i/i, Ui, and 5* =- {vj, Vg, ..., v„} be ordered bases for 

U and F, respectively Then we define a linear map S : U ->■ V hy pres- 
cribing values of S on the vectors of Bi as follows : 

S{Ui) = PiiVi + pgtVg + ... + P„x»’« . 

S(ui) — Pi/Vi -f pjjVg + ... + Pwll’m » 

^(w«) ~ Pin'll "I" Pint’s "I" ••• I" Pm»*'« • 

Extend S linearly to the whole of U. The linear transformation S is 
unique (Theorem 4.1.5). By this very construction, it is clear that 
B = (S : Bi, 5*). For this purpose, we have only to note that the coordi- 
nate vector of S[u,) relative to is the/-th column of B. S:U-*V thus 
defined is called the linear map associated with the matrix B relative to 
Bi and Bi. 

Note that an m X n matrix gives rise to a linear map from an n- 
dimensional vector space to an m-dimensional vector space. Further, note 
that, if we choose bases other than Bi and B^, the linear map associated 
with the matrix B will also be different. 

Example 5.8 Consider a 4 x 3 matrix 



156 / MATRICES 


~ 2 -3 4“ 

1 0 -1 

-2 1 o’ 

L 1 2 -2_, 

This matrix will give rise to a linear map S : Suppose 

= {“i. M*. «»} and ^2 — {vj, Vj, Vg, Vg} are ordered bases for F, and Kg, 
respectively. Write 

S(ui) = Jvi + Vs — 2vj + Vg 

5(Wa) = -3v, + Vj + 2rg 

<S{«3) = 4vg — Vj - 2vg . 

The linear extension of this definition of S on the basis elements is the 
required map S. If 5, and Bg are the standard bases {e„ e^, e,} and 
{fufufijfi) for and Kg, respectively, then we get a linear transfor- 
mation T : F 3 -> Ft given by 

r(et) - (2. I, -2, 1), T(et) = (-3, 0, 1, 2). T(e,) = (4, -1, 0, 2), 
i.e. r(jci, Xf, Xs) — ( 2 xi — 3xt + 4xa, Xj — X 3 , — 2 xi + Xs, 

ATj + 2jf2 + 2 x 3 ) . 

Let >Am, n denote the set of all m X n real matrices. Let U and K be 
real vector spaces of dimensions n and m, respectively. Fix ordered bases 
Bi for U and B 3 for K. Then the process of determining the matrix of a 
linear map and the linear map corresponding to a matrix shows that the 
map 

K)-> (1) 

defined by T(r) = (T : B^, B^) is one-one and onto. 

This result merely says that, if bases Bi and B 3 are fixed, then to each 
linear map T :U F there exists a unique m x n matrix and to each 
m X n matrix there exists a unique linear map from U to K. This enables 
us to pass from linear transformation to matrix and vice versa. 

When U = Fn and F = F„ and the bases Bt and Bt are the standard 
bases in the spaces, then the matrix associated with 7* : K„ -»■ K^ is called 
its natural matrix. 

Note (cf Example 5.7) that tIO) == Omxn' Further, note (cf Example 
5.6) that, if 

T : L(£/) -> , (2) 

then t(/) = In, where I is the identity transformation on D, and /* is the 
n X n identity matrix. 


Problem Set 5.2 < 

In Problems 1 through 4, for each given mx n matrix A and bases B^ 
and Bt, determine a linear transformation 7 : K, K«, such that 
A = (T:B3,Bt). 
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“112 3“ 

1. 10 1-1 . 

_1. 2 0 0_ 

(a) Bx and Bt are standard bases for V^ and respectively 

(b) Sj = {(1,1,1,2), (1, 1.0.0), (0,0. 1,1), (0,1, 0,0)}, 

Bi {(1.2,3). (1, -1.1), (2, 1, 1)}. 

“10 0 1 

2. A ^ 0 10 . 

_0 0 1_ 

(a) Bx - Bx - {e„ e^, e,} 

(b) Bx - {(1, 1, 1). (1.0,0), (0. 1,0)}, 

21*- {(1,2, 3). (1, 1, 1), (2, 1, 1)} 

(c) Bx -- {(1.2, 3). (1. -1, 1), (2, 1, 1)}, 

B*- {(1. 1, 1). (1,0,0), (0, 1,0)}. 

ri i 2n 

3. ^ I 1 . 

13 10 1 

(a) Bx and B* are the standard bases for K, and V^, respectively 

(b) Bx - {(1,1,1), (1.2. 3) (1.0,0)}, 

Bx - {(1. 1). (i.-l)} 

(c) B, - {(1, 1,1), (1,2,0), (0,- 1,0)}, 

5 , - {( 1 , 0 ). ( 2 , 1 )}. 

- 1 2~ 

4. A =■ 0 1 

. - - 1 3_ 

(a) Bx and B^ are standard bases for K* and respectively 

(b) Bj- {(1, 1),(-1,1)}. 

B, -- {(1, I, 1), (1,-1, 1), (0,0,1)} 

(c) B, -{(1,2), (-2,1)}, 

Ba- {(1,~1,-1). (1,2, 3), (- 1.0,2)}. 

5. If o “ ft~| IS the matrix of a linear map T : 

L-Sin u cos 

relative to the standard bases, then find the matrix of T-^ relatise to 
the standard bases. 

6. True or false ? 

(a) The matrix of the linear map T : (/ -> K is square iff dim V = 
dim V. 

(b) An identity matrix is a square matrix. 

(c) A zero matrix is a sijuare matrix. 
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ri 0 0“ 

(d) 0 0 1 is the matrix of the identity transformation 

_0 I 0_ 

/ : Fg -> F, relative to the bases Bi = (ei, e,} and B, = {e\, 

^ 3 . et). 

-1 on 

(«) 0 1 determines a linear transformation from F, to Fg 

_.l IJ 

defined as Tifii) = /„ r(e*) = f^, T(e^ —fi+ ft relative to the 
standard bases {e^, e^, eg} and {/„ 

5.3 LINEAR OPERATIONS IN iK„, „ 

Throughout this article V and V are real vector spaces of dimensions 
n and m, respectively; and Bi — {ui, Ug, «»} and B^ — {vi, Vg, Vb,} 
are ordered bases for U and F, respectively. 

Let T and S be two linear maps from V to F. Then r + 5 is also a 
linear map. If the matrices of T and S relative to Bx and B^ are A = 


(*i#)mxn and B — (p,j)«xn. respectively, then 



Tiu,) = 2 a„v. 
f = l 
and 

U =1.2,. 

#») 

(1) 

m 

S{u,) = 2 p,,v, 

1=1 

(y = 1 . 2 , . 

.., n ) . 

(2) 

So (r + S) (tty) = r(tt,) + 5(tty) 




= 2 («yy + P,y)Vy 
/=! 

(y = 1 , 2 , .. 

«) . 

(3) 


Therefore, the y-th column of the matrix ofT+S relative to B^ and B, is 

(*lj "i" Pu» "i” Psii •••. “I" Ph> •••> ^mi "1“ Pml)^ • 

Hence, the matrix of T + S’ is 

*11 "I" Pll *13 + Pis ••• *M + Pi# ••• * 1 » + Pin""! 

*31 + Psi *13 + P33 ”• *3# + Pi# ••• *3« + Pin 


. ( 4 ) 

*<1 + P#1 *#1 *}■ P#1 ••• *<# + P## ••• *<n + Pin 


L.***! "I" P«»l P«»l *«ll "t" PnH ••• *nMi + Pam, 
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This motivates the following definition of addition of matrices. 

5.3.1 Definition Let — («.,) and B = (P,^) be two mxn matrices. Then 
the sum it + is defined as the mxn matrix (a,^ -|- 

In other words, the sum of two matrices (of the same order) is obtained 
by adding the corresponding entries. 

Example 5.9 Let 

ri 3 2 ~i r-1 2 in 

^=1 . I . 1 . 

LO -1 IJ L 3 1 2_j 

[“1-1 3 + 2 2 + )“1 rO 5 31 

Then A + B=\ | - | | . 

LO + 3 -1 + 1 1 + 2J L3 0 3J 

5.3.2 Remark The argument preceding Definition S 3. 1 says only that the 

map T ; L{U, V) ->■ JA„, * of § 5 2 preserves addition, i e. ^(T + S) — 
T(r) + t(S) for all T,Se UU, V). 

Let T \ U V he & linear map and « a scalar. Then xT :U -> V\s 
also a linear map. If the matrix of T relative to and B^ is (tr.j)mxn> 
then 

nt 

r{uj = 2 a„v, (7 = 1,2, n) . (5) 

I 1 

So (*T) (Uj) - xT{u,) ^ S (««„)v, (y = 1, 2, .... «) . (6) 

i I 

Ihcrefore, the y-th column vector of the matrix of xT relative to By and 

By IS 

(««U. O'Otjl. «*«,)’■ . 

Hence, the matrix of xT is 

r «a,x aaij ... tt«j, ... xxy^ ~] 


xxfi aa,, ... ouXff 




( 7 ) 


L“*ml «'«ml — ««my — 

This motivates the following definition of scalar multiplication for 
matrices. 

53.3 Definition Let A «= («(,) be an m x n matrix and a a scalar. Then 
the scalar midtiplkation of A by x denoted by xA is defined as the 
mxn matrix 

In other words, multiplication 0f a matrix by a scalar « is done by 
multiplying each entry by «. 
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Example 5.10 Let 


Then 


ri 3 2 -i 
I I- 

LO 1 IJ 




r-i -I -n 

L 0 -iJ 


5.3.4 Remark The argument preceding Definition 5.?.2 says only that 
the map x : L(U, V) -> „ of § 5.2- preserves scalar multiplication, 

i.e. T{«r) = «T(r) for all T G HU, V). 

From the definition of addition and scalar multiplication it immedi- 
ately follows that Uim, n is a real vector space. (The reader is advised to 
go through the various steps of verification.) Note that the zero element 
of this vector space is the zero matrix Omxn of Example 5.7. 

Further, Remarks 5.3.2 and 5.3.4 show that the map x : £,(£/, V) 
JAm n is linear. Since we have already proved in § 5.2 that x is one- 
one and onto, it follows that x is an isomorphism. We collect all these 
results in the form of a theorem. 

5 3.5 Theorem (a) >A„, » is a teal vector space for >he fore^’oing 

definitions of addition and scalar muhipiication. 

(b) X ; L{U, V) -> iKm, n d^ned by xfT) = (T : 5*) is an iso- 

morphism. 

/ 

The implication of this theorem is that, for all practical purposes of 
linear algebra, linear transformations between finite-dimensional vector 
spaces are just matrices and vice versa. 

We shall now determine the dimension of L(V, V). By Theorem 5.3.5, 
it is the same as the dimension of because isomorphic vector spaces 

have the same dimension. (Why ?) So we have only to prove the 
following theorem. 

5.3.6 Theorem The dimens on of the vector space „ is mn 

Proof-. Given i and j, define the matrix £,< as the m x » matrix 
with 1 in the //-th entry and zero in all the other entries. We claim that 
the set B of matrices 

P ~ {£ii, ..., £i». .^21. £*«, •••. £mi» •••, Ef»n} 

= {£« G I I = 1, -, w;; = 1, ..., „} 
is a basis for «. 

To prove that R is ii in we assume «u£„ {- ... -j- «i„£,* 

+ *ai^M + ••• + ■!* ••• + +■ — + <^mnPmn ~ This 

means that 
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«u 

a„ ... 

«1«"1 


-0 

0 

... 0 ~ 


a,* ... 

«*n 

= 

0 

0 

... 0 


*m» ••• 

®inn — 


LO 

0 

.. 0 _ 


Hence, a„ = 0 for all i = 1 , m and j — \ «. Thus, B is Li. 

Again, to prove that [B\ - let us take a general matrix A = 

(it.,,) in Then it can be easily verified that 

A ^ *11^11 ■!" + ... + <X«n£gn + 

"f* ... i* ^mn^mn • 

Hence, is a basis. Hence the theorem. | 

The basis {£,, | i 1, ..., m\j= I, ..., n) is called the standard basis 
for «• 

Combining Theorems 5.3.5 and 5 3.6, we have the following corollary. 

5.3 7 Corollary // U and V are fimte-dimensijnal vector spaces, then 
dim L(U, V) dim U x dim V. 


Problem Set 5.3 


In Problems 1 through 4 determine a.A + for the given scalars a 

and p and the matrices A and B. 


1 2 J 


1. A 


L-1 1 1-1 
(a) a = 2, p -= 7 


r 1 0 in 
? = I l. 

L2 1 -IJ 
(b) « - 3, p = -2. 


ri 2n ri on 

2. A = I 1,5=1 I 

L3 U 1_2 -IJ 


(a) a == 3, P 


(b) a - 2, p 3. 


““ 

1 2 

3 

4n 


-3 

-1 

2 

0“ 

3. - 

1 1 

1 

1 

.5 = 

1 

5 

7 

3 

_ 

3 1 

2 

OJ 


_2 

1 

C 

1_ 

(a) « = 

2,P 

rrs - 

-6 

(b) 

a « 

3.P 

= 

5 


(c) « = —7, P — 3. 

-1 -1 m ri 0 2 

4. 2 -3 -1 .5= 0 1 1 

^3 2 OJ L3 I -1 
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(a) « = 7, p = —5 (b) « = 1/2, p = 2/3 

(c) « = l/3,p = 4/5. 

5. Let r„ T* : f/ -> K be two linear maps. Let B, be ordered 
bases for U and V, respectively. Then prove that 

(cijT'i Sxt jSSa) “ *1(7" i t B^t B^ *g(72 . 5j, iSj). 

6. Let S,T:Va->V^\K^ defined as 

iS(af|, Xg, ^^3) — (X| “I" af2, aTj 2x3 "f~ X3, Xg "H 3x3, ~i” ^s) 

r(x„ x„ X3) == (Xi + 2x„ Xi — Xa, 3xa + x*, Xi + Xj + x,). 
Determine the matrix of 3S — 4T relative to the standard bases by 
two different methods. 


7. Let S, T : 93 9i be defined as 

(S{p)){x) = (X* - l)p'(x) 

(T(p))(x) = (3x + 2)p{x) - J* p’(t)dt. 

Determine the matrix of 45 + 2T relative to the ordered bases 
= {1, X, x*. X*) and Bi - {(1 - x), (1 + x), (1 - x)\ (1 - x)*, 
x*l2} by two different methods. 

8. Let Bi = {«j, «a, ..., «»} and B3 = {vj, v*, .... v*,} be ordered bases 
for the vector spaces U and V, respectively. Define T{f :U V, 
1 < f < m, 1 <J<n such that 

^ ^ _ fO if A ¥= i 


Then prove that 

(a) {T„ : Bi, Bt) = (cf Theorem 5.3.6) 

(b) {T„} is a basis for L{U. V). 

9 . Define T : jAj, 3 -> JA,, 3 such that 


^ r«ii *ia“l r «11 + «1S 0 «„ + a,,-] 

1— *»i **»— i I— *u **i + **» 0 J 

Prove that T is linear and determine its matrix relative to the 
standard bases for ^A3, , and >At, 3. 

10. Repeat Problem 9 for 7* : 3 >A3, t defined as 

n*u “is *is*i r~“ii + *u + *i» n 


“mJ 


P“ll + ®U + *1» 

L «M ecii + «i» J 


11. Let P be the subspace of ^(’*>(—00,00) spanned by the functions 
sin X, cos X, sin x cos x, sin* x, co^ x. Determine the dimension of 
P, and prove that the differential operator D* maps P into itself for 
every positive integer n < m. 

Determine the matrix of (a) 2D + 3* (b) 31)* — D + 4 relative 
to the basis of V obtained from the given spanning set of V. 
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12. True or false? 

ri 3 n r4 6n 

(a) 1 ^ 1 + 1 I 

L4 5 7j L5 -IJ 

r a 3«n ri an 

(b) I l-apl i, 

L2p 4PJ L2 4J 


r6 9 n 

I 1 
L9 4 7j 


(c) 0 j 4 = Omxi» for any m x n matrix A 

(d) The set of all square matrices is a vector space. 

(e) Every matrix can be written as the sum of two matrices, one of 
which IS two times the other. 

(f) The set of all 3 x 3 matrices of the form 


r 0 a p n 

I 

Y 0 6 

_ » P 0 _ 

IS A group under the operation of addition. 

5.4 MATRIX MULTIPLICATION 


Hereafter, we shall use only standard bases in the vector spaces 
unless otherwise stated. 

In this article let 5 : F, -> F„ and r : F„ -> V„ be linear maps. Let 
Bi ~ {Pi, Cj, . , Cn}t ■®i “ {/i> •• j^m}, and = {gx, s»> •• » 8p} be the 

standard bases for V„, V„, and V,, respectively. 

Let the natural matrix for T he A = («„)mxn» and that of iS be 
B = (Po)nXj>* 

We know that TS : F, -> F^ is also a linear map. Let the natural 
matrix of 75 be C = (Yt>)mxp- We shall now calculate y.i in terms of «’s 
and p’s. We have, for each k = 1, 2, , n, 

7(e*) = 2 «,*/, 

1=1 

= *U:/l “f" “t" ••• "i" *•*/• "i" ••• "I" ^mkfm (I) 

and, for each^ -= 1, 2, .. ,p, 

S{gi) = 2 pirfe* 

“ Pii^i "H Ptr^s "I" ••• "I" 4" ••• "I" Pai^ii • '■ (2) 

Also, for each j — 1,2, ...,p, 

{TS) (gf) — S Y«/i 

•“ XuA "I" Xtf/t "t* ••• + Xu/f "1* ’•* + Xmifm - (^) 
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Now, for each j = 1, 2, .. ,p, we also have 
(rs)(f,) ns(g,)) 

~ + Ps,e» +...-+ ^it,eic + ... 4- PnjP*) (by (2)) 

- Pi^n^i) + Met) + ••• i PwTXe*) 

+ ••• + Pii,r(0 » (4) 

because T is lirear. Each of the terms on the right-hand side of Equation 

(4) is, by Equation (1), a linear combination of the vectors fuft, 
Collecting the terms involving /i, we see that the coefficient of /, on the 
right-hand side of Equation (4) is 

Pl>*<1 + P*;«i2 ■!-... + Pjt,«t* + ... -f PnJ*«n ' 

— *«lPlJ + *«*P*j4 ••• + “t*P»j + ... + «.nPnJ 

— 2 «.*P*, . (5) 

k- I 

Comparing this with the coefficient of /, on the right-hand side of 
Equation (3), we get 

Y.j (6) 

A;-l 

for every i - 1,2, ... m and j — 1,7, . ,p. 

Using this as motivation, we define the product of two matrices as 
follows. 

5.4.1 Definition Let A = (a,^) be an m x n matrix snd B — (P„) an 
n X p matrix. Then the product AB is defined as the m x p 
matrix C = (y.i), where 

n 

Yi, “ I “ I, 2, ..., 01, J « 1, 2, »•., p. (7) 

In orr’er to understand and use this definition, we shall define the 
‘inner product’ of two vectors in 

5.4.2 Definition Let u = (xj, x*. ..., x„) and v = Oi, y*. ...,y„) be two 
vectors in V„. Then the inner product of u and v denoted by u > v is 
the scalar 

«• V = XiPi + Jf2P» + ... + . 

For example, if « = (1, 2, —3) and v = (0, —1, 2), then « ■ v = 1 x 0 
-H 2 X (-1) + (-3) X 2 - -8. 

By this definition, the expression for y</ in Equation (7) becomes 

Y« “ + *«Pm + ... -f 

*** (*<H ...» *<«) • (Pm» Pil» •••• Pul) 

— (>‘-th row vector of A) • (J-th column vector of B) , (8) 
)x>th being considered vcctrrs in 

So Definition S 4.1 can be reworded as follows, 



5.4 MATRIX MULTIPLICATION / 165 


5.4.3 DefiaitioR (Reworded) Let A = (a^^) be an m x n matrix and 
B — (P«) an M X matrix. Then the product AB k the m x p 
matrix C = (y<,), where y« « the inner product of the i-th row 
vector of A and the >th column vector of B, for i = 1. 2, .... m and 
y — 1, 2, ...,p, both being treated like vectors in 

Example5.il Let 

r3 1 2n 



Here ^4 is a 4 x 3 matrix and .0 is a 3 x 2 matrix. So AB is the 4x2 
matrix 

~Yii Yij“l 
Yai Yaa 

' 9 

Ysi Ya» 

I— Y« Y«— 

where 

Yu = (1st row of A) • (1st column of B) 

= 3x1+1 x0 + 2x (-2) = -1 
Yu = (1st row of A) • (2nd column of B) 

= 3 X (-1) + lxl+2x3 = 4 
Yji = (2nd row of A) • (1st column of B) 

= 0x1 + (-1) X 0 + 1 X (-2) = -2 , 
and so on. Completing the calculations for all the y’s, we find that 


Example 5.12 Let 

n + / 

A » I 

L.4 + / 



-i 2“I 

I and B 
1 - / OJ 



1 - n 
2 

i J 


Here a4 is a 2 x 3 matrix and 0 is a 3 x 2 matrix. So AB is the 2 x 2 
matrix 
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L««i «»*J 

where = (1 + i)0 - /(I) + 2(1 - /) -= 2 - 3/ 

«i, - (1 + i)(l - 0 - /(2) + 2/ = 2 

«2i = (4 + 1)0 -I (1 - «•)! + 0(1 - I) = I - / 

«M == (4 + 0(1 -/) + (!- 02 + Oi = 7 - 5/. 

\-2 - 3i 2 n 

So AB^\ I . 

LI - I- 7 - 5iJ 

5.4.4 Remark The discussion preceding Definition S.4.1 proves that if 
T : L(Vn) -*■ JAn, n 's defined by 'i(T) — the natural matrix of T, 
then T(rS) = T(r)'r(S) for all T, S G L(K,) and -r^AB) = 
t"^(R) for all A,B£. iK„, 

In other words, the composition of transformations corresponds to 
matrix multiplication. 

Let us further analyse the process of matrix multiplication, namely, 

r ... pij ••• 1 




Paj ••• 



: ! 

: : — 




: “1 

«•! 

... a,jt a,|, 


p*, ... 

= 

Yty ••• 

— : • 

• 5 J 


— ••• Pni •••-J 

L 

• - 


Here attention is focussed on the f«ct that the //-th element of AB is (l-th 
row of A) • (y*th column of B). But recall that we can form the inner 
product of two vectors only if both have the same number of coordinates. 
In other words, in order that matrix multiplication be possible, we 
should have the number of entries in the Mh row of A equal to the 
number of entries in the y-th column of B, i.e. the number of columns of 
A should be the same as the number of rows of B. Thus, an m X n 
matrix A can be multiplied on the right by a q x p matrix Biff a ^ q. 
If ft ^ 9 , then the product AB is not defined. 

A 1 X R matrix A is simply a row vector cf the form (a^, aj. 
An R X i matrix B is simply a column vector of the form (pi, pi, ..., 

The product AB of these two matrices is a 1 x t matrix + Rih 
+ ... + a„p«], whose only entry is nothing but a scalar, which is ^ 
inner product of vectors A and B. 

In general, matrix multiplication is not commutative. For, if 
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ri on r3 on 

A^\ |,J=| i.c 

L2 IJ LI -IJ 

then 



2n 

ij 


-1 



> 


r3 on r3 on 

AB^\ 1 and = I | . 

L7 -IJ Ll -IJ 


r -1 -in 

Hence, AB ^ BA. But we find that CD — \ | = DC. 

L I -2J 

On the other hand, we have the fijilowing theorent. 

5.4.5 Theorem (a) Matrix multiplication is associative, that is, {AB)C 
== A(BC), whenever riihcr side is defined. 

(b) Matrix multiplication is distributive over addition, that is, 
i4(B ^ C) = AB AC, whenever either side is defined. Also, 
(B + C)D = BD + CD, whenever either side is defined. 


The proof is left to the reader. Note the folio wini : 

(•) Omxn-^fixi = OmX* 

■'^»X*6j»X« — OnXm- 
(ii) fn-'^nXm ™ ^«Xm SOd 


5 4.6 Definition If A and B are square matrices of the same order such 
that AB = I — BA, then B is called an inverse oj A. 

Example 5.13 Let 


Then 



~ 1 2 3n 


■ i -i -r 

A = 

0 1-2 

,B = 

1 -2 1 

1 

_-l 1 IJ 


L-i I -i- 


AB = 


rl 0 0“" 
0 10 


= BA. 


LO 0 IJ 


Therefore, B is an inverse of A and A is an inverse of B. 

5.4.7 Theorem If an inverse of a matrix A exists, then it is unique. 

Proof : Suppose that B and C are two inverses of A. Then AB s / 
v= BA and AC ^ I = CA. Thus, we have 
C ^ Cl = C(AB) 

« (CA)B (Theorem 5.4.5(a)) 

^ IB <^B. 


Hence, B = C. | 
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In view of this theorem, we speak of the (unique) inverse of A and 
denote it by A~K Whenever A ^ exists, A is said to be invertible. 

By Theorem 5 4.7, it folio »vs that if A"^ is the inverse of A, then A is 
the inverse of A~^, i e. {A~^y^ — A Both the matrices are therefore 
invertible. 

5,4*8 Theorem An n y. n matrix A is invertible iff the corresponding linear 
transformation T (via the standard bases) is nonsingular. 

Proof ; Suppose A is invertible. Then there exists an n x n 
matrix B such that AB — BA. Let the linear transformation 
corresponding to B be B : Then, by Remark 5.4.4, 

- T->(/„) - t-\BA) 

or T 

or rs -= / 57 . 

So, by Theorem 4.7.2, T is nonsingular. 

Conversely, if T is nonsingular, then there exists a linear transfor- 
mation S : Vn -*■ Vn such that TS - / — ST. Therefore, by Remark 
5.4.4, t(TS) — t(/) - T(5r). If B is the natural matrix of 5, we have 
AB = In — BA. Hence, A is invertible. | 

For this reason, a square matrix that is invertible is called a non- 
singular matrix. A square matrix that is not invertible is called a 
singular matrix. 

The foregoing ideas can be used in solving certain linear systems of 
equations. To do this, we first write the system in matrix form. 

Suppose that 

n*U *1* ••• *ln ~1 ~ Xi"~ 

and X — — (Xi, X|, ..., x#)^ 

L«ml - «mn J | L _ 

Then i4x is the m x 1 matrix, i.e. a column vector with m entries : 

*U*1 + *U*1 4" ... + t^inXn ”1 

*11^1 + + ••• + *tnXn 

Ax » 

• • • 

• ■ « 

• • • 

+ ... + OlmnXn 

Further, suppose we have m linear equations in n unknowns ; 
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*1X^1 ^ *12^2 + ••• + *1»^» >'l 

*21^1 + *22^2 + — + «2n-'*fn = yi 

: : (9) 


amiJfi 4 a«2-«x ^ • •• "I" ®fnn^» " • 

The system (9) can be written in the matrix form 


r «ii 

*ia 

... am 1 

’ft 


■ yi 

O'?! 


... a^n 

1 

: 1 

Xi 


yi 

Lami 

am2 

1 

... «mnJ 

L. .v„ . 

1 

L. >’m _i 


or Ax--y, (•!) 

where x is an unknown column vector and y the given column vector 
CVi. ^ 2 » •• > ^be system has n equations in « unknowns, then A is 

a square matrix, and x and y are n x I matrices. 

Further, if A is inveitible, then A "* exists. Multiplying both sides of 
Equation (I I) on the left by A~^, we get 

— A'^y 


(/l"‘.4).v ^ A-'y (Theorem 5.4.5) 

or InX -- A '^y 

or X - A^y, 


Problem Set 5.4 

1. Determine the inner product u •’ in the following cases : 

(a) M=-(l. -1), i'-(2,3) 

(b) u — (1, 2, 3), V - (3, 0, 2) 

(c) M- (-1, 1,2,4), V - (1,2, -1, 1). 

2. Evaluate the following products : 


^1 2 3"! 


r n 


r3 1 2 -1" 

4 0 1 


2 

(b) 

7 3 1 0 

_3 0 OJ 

1 

L-l-J 

1 

LO 2 1 4_ 


r n 1 

1 

r n 

2 I 

2 

(d) 

-1 

1 

- 1 

o 

1 

L 1- 


(c) 12 -1 1 3] 


13 1* 2] 
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/“I r 2 n 


u -ij L / J 

3. For the given matrices A and B, determine the product AB or BA, 
whichever exists. 




ro 

1“ 



n 

3 

on 




A = 1 


1.5= 3 

2 



L2 

1 

3J 






LI 

5_ 






1 


2- 

n 

3 

on 

0 


-1 

A = 1 


1.5 = 




i_2 

1 

3J 

-5 


7 




3 


4_ 

“1 


5 7n r 

1 

2 

3n 

A = 3 

- 

-1 0 .5 = 

0 

1 

2 

_0 


1 

2 IJ l3 

7 

0_ 

r3 

5-1 ri 2 

3 

4 

5n 

A= 1 


1.5=1 



1 

L7 

IJ. LO 1 

3 

0 

ij 




r 


0 2 

n 

2 

3 0 in 

1 




(e) = 0 10 10 .B = 


3 5 
-1 1 


L3 0 1 2 5J 

Loo -2_| 

ri n r-i n 
( 0 ^ = 1 1 . 5=1 |. 

U -IJ L.-i - IJ 

4. Determine A~' for the given matrix A in each of the following : 

ro n n 21 r« n 

(a) ^=1 1 (b) ^ = 1 1 (tf) 1,1 

LI OJ LO IJ LP OJ 


r« on 

(d) A *= \ , cif 0 (e) A = 2 1 0 

LP yJ 

_1 0 2 « 

S. Compute A*, A*, and A* for each given square matrix A. 



LP OJ 

“1 0 

-2- 

2 1 

0 . 

^1 0 

2> 


P#0 
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n 2 3n r 3 0 n 

n 21 

(a) 0 2 1 (b) I 1 (c) -12 0. 

L3 IJ 

L3 -I OJ L 1 5 7J 

6. Determine all 2 x 2 matrices that commute with 

r 1 2n ro in ri on 

(a) I I (b) I 1 (C) I I 

L-1 OJ LI -IJ LO 2J 

r 0 in 

(d) I |. 

L-1 OJ 

r 0 in r3 in n on 

7. I 1 .11= 1 1 I 1 . 

L2 IJ L2 -IJ L2 IJ 


ri 2 3n 
D= 1 I 

LO -1 IJ 

equations : 

(a) ^X- AB^C 
(c) EXD = /. 


- 1 2n 

£ = 10, solve the following matrix 

L-1 ij 

(b) {BXD + AXD)E =» C* 


1 

r\ 0 ... on 

1 

1*1 0 ... 

o 

.J 

00 

II 

0 \ ... 0 

: : : 

,B - 

0 (ij ... 

• • 

• • 

• • 

0 


r 

o 

0 

a 

1 


LO 0 ... 

1*1.- 


Compute (a) AB (b) BA (c) A~^, if it exists. 

9. An R X R matrix A is said to be nilpotent if A” = 0 for some positive 
integer n. ,The smallest positive integer r, for which A" = 0, is 
called the degree of nilpotence of A. 

Check whether the following matrices are nilpotent. In the case 
of nilpotent matrices find the degree of nilpotence. 


-0 

0 

0 

0” 

ro 

1 

2 

-in 

« 

0 

0 

0 

0 

0 

1 

2 





(b) 




Pi 

Ps 

0 

0 

0 

0 

0 

1 

-Yi 

Tt 

Ys 

OJ 

- LO 

0 

0 

0_ 
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n 

5 

-2“ 

r 1 

-3 -4“ 

(c) ! 1 

2 

-1 

(d) -1 

3 -4 

L3 

6 

-3_ 

L. 1 

-3 -4_ 


10. If i4 and B are square matrices of the same order* then piove that 

(a) - {A - B)(A J- B) iff AB - BA. 

(b) A* ± 2AB f fl* -= (^ i fl)* iffAB = BA. 

" «u «12 <h3 1 

11. Denote the matrix A =- «ji a^. 


1 

L- ®J1 *32 *33 - ^ 

Ann 

as =- 1 


1 , where An - the matrix [«ig auj, 

1 


A 22 

f-«2i “i 


r « 2 !! « 2 »n 

A 21 — 1 I , 

, A 22 

— 1 1 . Similarly, define .8, ^n, ••• by 

— 1 

J 


t— *J2 *33 -J 

replacing a„ by p„. 

Then prove that 


r All ^11 ■^1* "i’ 

A -j- B — \ I 

L'^ai 4 Bii ^9.% 4- ^2?_1 
r AiiBii T Ai^Bn AiiBi2 +■ ■'4i.i5g2 i 

and AB \ 1 . 

4- A^iB’ii A^iBif 4" AggB^^—i 

12. If«, P arc any scalars, then prove that A^ - (« + p)A + »^/ 

(A — »/)(A — p/), where A is any square matrix of order n and 
/= f„ 

13. If a, p are scalars such that A — aB -h p/, then prove that 
AB = BA. 

14. A square matrix A is said to be involutory if A^ -- 1. Prove that the 

ri an r 1 on 

matrices | | and j | are involutory for all scalars 

LO -IJ L« -IJ 

a. 

Determine all 2 x 2 involutory matrices. 

15. Let T : L(VJ -*■ „ be defined as in expression (1), § S.2. Then 

prove that t '^(AB) ~ v~^(A)r~\B) for all A, B £ >R», „. 

16. Let p(x) — fto -h «ix 4- ... 4- «»»*" a polynomial of degree n, and 
A be a square matrix of order m Then the matrix polynomial p{A) 
is defined as />(>4) =.a^ 4- iXiA 4- ... 4- »hA*, where I = /«. 

If /{x) =» 7x* — 3jf 4- 5, g(x) *='3** — 2*® 4- 5* — 1, 
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r 1 2n r-i n 

•<4=1 I > and .8 =■ I | , evaluate 

L-1 3J L 1 -2_l- 

(a) M) (b) g(A) (c) AB) (d) g(B) (e) /(2^ + 3B) 
(f) gOA-lB). 

17. Prove Theorem 5.4.5. 

18. Using matrix methods, solve the following systems of linear 
equations : 

(a) X ly -= ‘h (b) ax + ^y — a (c) x ~ 22 — 1 

><—1 {Jx — b Qx y —2 

X H- 2z = 3. 

19. if A and B are two nonsingular matrices of the same order, then 
prove that AB is nonsingular and {AB)-^ — B~^A~^. 

20. Prove that the set of the following eight matrices forms a group for 
matrix multiplication : 



n 

on r 

-1 

on 

/ - 

'1 

1 . A - 1 


1 


LO 

IJ L 

0 

- IJ 


r -I 

on 

n 

on 

D,= 

1 


1 

1 


L 0 

ij 

i.o 

-iJ 


r 0 

in 

r 0 

-n 


1 

1 » — 

1 

1 


L-l 

0. ! 

LI 

OJ 


r 0 

-n 

\ 0 

n 

D, = 

1 

1 > ^7 ~ 

1 

1 


i_-i 

oj 

L./ 

OJ 


Write the multifile Uion tab'e of the group. 

21. Trucorfalse? 

ra b~[ r-a b~\ p-a® + h" ac +bd~] 

> II 1 = 1 ^ I • 

Le d_i L c d_i \_-ac + bd c* + d*_J 

(b) If AB — I, then A is invertible. 

(c) If .<4 and B are square matrices of the same order, then 
AB = BA. 

(d) The system of two equations 2x + 3y = land 4x 6^ = 2 
cannot be solved by the method discussed in this article. 

(e) Let i4 be 2 X 3 and B be 3 X 2 matrices. Further, let C be 
2x2 and D be 3 x 3 matrices. Then 

(i) AB is defined but not BA. 

(ii) AB and BA are both defined* 
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(Hi) BC is defined but not CB. 

(iv) DA is defined but not AD. 

(f) For every integer r > 1, there exists a nonzero n x n matrix 
which is nilpoteot. 

(g) For every integer n > 0, there exists a nonzero r x n matrix 
which is nilpotent. 

5.5 RANK AND NULLITY Of A MATRIX 


We have seen that every nt x n matrix A corresponds to a unique 
linear transformation T : Fa -> where we have agreed to use the 
standard bases in both spaces. We shall now show that the value of T at 
an arbitrary vector x is just the effect of matrix multiplication of i4 by x 
in that order. 

Let A (»ij)„xn- Let the standard bases in and V„ be {ei, 

^1. <’«} and {ft, ft fm), respectively. If .v = (x^, x,. .... .x*) is an 

arbitrary element of V„, then x = x^e, + XtCt + ... + Xaf*. Let 
T: Fa -> F„ be the linear transformation associated with A. Then, for 
each; = 1, 2, . ., r, 

T(e,) - o-tifi -!- «2i/* 4 - ... + *«;/« — («i„ «*/, ...» «mj) , ( 1 ) 

because {ft, A, ■••./«} is the standard basis for F«. Writing these r(e,)’s 
as column vectors, we get 

IXx) = r(xi<*i +- x*e, + ... + XaCa) = x,r(ci) + Xj^e,) + ... -f XaTXe,) 


r«un 


1 

1 

r 

L.. 


*21 


*22 1 

a2n 


: 

4- 

'+•••+ Xn 
• < 

1 


1 

- «»»! J 

i 1 

1 

L««2J 

— *fMn 


* 11^1 4- ««X 3 -1- ... -f- a,aX„ 

«21^1 + -{■ ... + «2,Xn 


l.»miXt + »mtX, 

+ + *m«^i»_! 

r «U «2t ••• 

*11. ~1 


"*in 

*21 *22 

*2« 

• 


*2 

««l ... 

• 


..Xn- 


Ttips, the vector T(x) ie ohtgipcd by multiplyiof the metrix A by the 
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column vector x = Xt; x^J in that order. In this sense there- 
fore a matrix can be identified with the linear transformation it represents. 
In other words, if ^4 is an m x r matrix, then the corresponding linear 
transformation T* : represents the operation of matrix multipli- 

cation of A by vectors of the space V„ (assutning that we use standard 
bases throughout). 

Let i4 be an m X R matrix (a„). Instead of talking of the linear 
transformation T associated with A, we talk cf A itself as the licear 
transformation, the understanding being that the value of the linear trans- 
formation A at X = (xi, Xi , ..., x„)^ is just the matrix product Ax. 

5.5.1 Definition T/ie range, kernel, rank, and nullity of a matrix A are 
defined as the range, kernel, rank, ard nullity of the linear 
transformation A. 

Range of A The range of >4 : K„ - ^ is the set of all vectors of the 
form Ax € V„, x V„. For A — («„), it is the set of all column 
vectors of the form 

i- + ••• 1 “in-'n ~ 

«„Xj 4 ajiXj, I- .. + a.i„Xn 





■”«in 




I C. Xx 

«21 

+ -T, 

0^22 

4 ... H x„ 



1 

Lama- 



Which are just linear combinations of the column vectors of A. 
Obviously, column vectors of A are vectors of K,». 1 hus, we have the 
following result : 

The range of an m X n matrix is the fpan of its column vectors. 

Rank of A The rank of a matrix A is the dimension of the range of A, 
i.e. the span of column vectors of A. This shows that the rank of A is the 
maximum number of linearly independent column vet tors of A. 

Example 5.14 Let 

r3 1 2-i 


A » 


2-10 
1 1 1 


Lo I 2J 
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The range of A is [(3. 2, 1, 0), (1, - 1, 1, I), (2, 0, 1, 2)]. The rank of A 
is 3, since the three vectors listed are li. 


Example 5.15 Let 


A = 


r3 1 4 O' 
0 2 2 0 
1 -I 0 0. 


We have RiA) - [(3, 0, 1). (I, 2. -1), (4, 2, 0). (0. 0, 0)] = [(3, 0, 1), 
(1, 2, -1), (4. 2, 0)] = 1(3. 0. I), (1. 2, -I)]. since (4, 2, 0) = (3, 0, 1) 
+ (1. 2, — 1). The rank of A is 2, because (3, 0, 1) and (1, 2, —1) are u. 
Kernel of A The kernel of A is the set of all vectors Jc £ such that 
Ax — 0«ixi< 

Nullity of A The nullity of A is the dimension of the kernel of A. 


Example 5.16 Let 


2 n 


A =-- 


- 1 2 


L 3 OJ 

This is a linear transformation from to K,. We have 


■ 2 n 




r 2 xi + x* 


r* 0 n 

-1 2 




—X, + 2x, 


0 

L 3 OJ 


..Xt J 


L 3xi _j 

1 

L 0 J 


Thus, Ax = O 3 X 1 implies 

2xi + Jfg = 0, —Xi + 2*, == 0, 3*1 = 0. 

This gives *i = 0 = Xj. Therefore, the kernel of A is {0} and the nullity 
of A is 0, 


Example 5.17 Consider the matrix of Example S. 1 5. We have 




r 3 xi + X, + 4x3“! 

r 

c 

L 



1 




Xa 

J 


0 220 



1 






2*3 + 2X3 

!_1 -1 0 OJ 








L *1 - *9 J 


Thus, Ax — 0 implies 3*i + ** + 4*, = 0 , 2 *, + 2x, = -0, *1 — = 0. 

This gives Xi = => — x,. So the kernel of A is the set of all vectors 

of the form (Xi, Xi, — Xi, x*) = Xi(l, 1, —1,0) + xJ^Q, 0, 0, 1). It is 
therefore the span [(1, 1, —1, 0 ), (0, 0, 0, 1)]. So the nullity of A is 2. 

In Examples S.14-S.17 rank + nullity = dimension of K,. This 
theorem, which is true for linear transformations between finite-dimen* 
sional vector spaces, is also true for matrices, because of the identification 
pf matrices as linear transformations in the above discussion. 
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Recall that a linear transformation from to is one-one ((fit is 
onto. So an n X n matrix A will be a one-one linear transformation iff 
its range is the entire space, i.e. iff its rank is n. This means tha t the 
maximum number of linearly independent column vectors is n. dl other 
words, the column vectors of A are li. Since the foregoing argument is 
reversible, we have the following theorem. 

5.5.2 Theorem A square matrix is nonsingular iff its column vectors 
are u. 


Example 5.18 Let 


A ^ 


1 0 1 ~ 
1 2 3 
-1 1 0 _ 


The range of .d is [(1, 1, -1), (0, 2, 1), (1, 3, 0)]. 
consider 


For the kernel of A, 


n 

o 


r^ri 

1 1 

■ 0 “ 

1 2 3 I 


•Vj 

- 

0 

n 

o 

_J 

1 

L-X3.J 


1 

0 

i 


This gives Xi -1- =*0, Xi -f- Ix^ -1- 3T) = 0, — .Xi ^ Xg — 0. Solving 
these equations, we get - —x^, \i — Xg So the kernel of A is 
[(1, 1,-1)] Therefore, the nullity of ^4 is 1. So the rank of A is 
3 - 1 -- 2. 

The same result is obtained by inspecting the range of A. The range 
of is [(1,1,- 1), (0, 2, D], because (1, 3, 0) = (I, 1, —1) -f (0, 2, 1). 
Hence, the matrix A is singular. 


Example 5 19 Let 



-2 

1 

- 1~ 

A = 

1 

2 

0 


Ll -1 

- 1 _ 


The range of A is [(2, 1, 1), (1, 2, - 1), (-1. 0, 1)]. The rank of A is 3, 
because we can easily check that these three vectors are ti. Hence, A Is 
nonsingular. This can also be arrived at by showing that the kernel of A 
i8{0}. 

ri 2“i 

Example 5 20 Prove that X * 1 I is nonsingular and find its 

LO IJ 


inverse. 

The column vectors (1. 0)7 and (2, 1)7 arc u. Thercforci the matrix 
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r« pn 

is nonsingular. Assume that the inverse of X is | Then 

L.Y 

ri 21 r« pn ri on 

Lo ij Ly sJ Lo iJ’ 

r a + 2Y P + 2S1 ri on 
i.e. I 1 = 1 1 . 

L. Y S J LO IJ 

So a 1- 2 y = I, P + 28 = 0, Y = 0, 8^1, which gives a = I, 
P — — 2, Y = 0, 8 = 1 . It is easily seen that 

f 1 -2"i r* 2n ri 2n ri -2n ri on 

I II 1 = 1 II 1 = 1 I- 

LO IJ LO IJ LO IJ LO IJ LO IJ 

Hence, 

ri -2-1 
= I 1 • 

LO IJ 

Example 5 21 Find the inverse of the matrix 

- 1 2 3" 

A = 0 12. 

L-1 1 ij . 

The reader can check that the column vectors of A arc u and so A is 
nonsingular. To find the inverse, we solve the nlatrix equation 


r 1 

1 

2 

3n 


*2 

«3 1 

“1 

0 

0“ 

0 

1 

1 

2 

Pi 


Pa - 

0 

1 

0 

L-l 

1 

1 J 

LYi 


YaJ 

_0 

0 

1 _, 


We get n ne equations in nine unknowns. Solving, we get 

r i -i -n 




1 -2 


L-i 


I -iJ 


Alternate methods (which are more powerful) of finding the inverse of 
a nonsingular matrix will be described in § 5.9. 

Problem Set 5.5 


1. Find the range, kernel, rank, and nullity of the following matrices : 
r 1 3 21 r2 0 11 

1 ri -1 2 -] I 

(a) -1 7 2 (b) I 1(c) 7 1 2 I 

L3 -2 5J _ _ 

I 0 ij 


-2 0 11 
7 1 2 I 

-3 -I IJ 
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r2 3 1 2 01 

1 

ri -1 1 01 


0 3-121 

1 

2 3-11 

(d) 

, , '(e) 



1 -3 2 4 3 

1 1 5 2 0 

t 


L2 3 0 3 Oj LO 0 1 IJ 

r -1 1 in 
I I 


(0 3 1 -1 I 

_ 2 2 1_J 

2. Prove that the following matrices are nonsingular and And their 


inverses : 






( 1 

0 0 ; 


I'l 

-1 21 


r 

- 1 

21 


1 


1 


(a) 

1 


1 

(b) 2 

I 0 (c) 

3 

0 1 


L 

_-l 

OJ 


1 








.3 

4 2J 


LO 

1 1 



n 

1 

2 31 

1 

1 2 

2 

1 

1 



0 

2 

1 

1 1 

1 

0 


1 

1 

(d) 





(e) 



, 



1 

3 

1 -1 

1 0 

0 

I 

1 



LI 

1 

-1 OJ 

L 0 

0 

1 

0 j 


3 Find the values of a and |) for which the following matrix is invert!* 

ble. Find the inverse when it exists 

~a p on 

0 a P 

l_P 0 

4. Prove the following : 

(a) If two rows of a matrix arc interchanged, then the rank does 
not change 

(b) If a row of a matrix is multiplied by a nonzero scalar, then the 
rank does not change. 

5. True or false 7 

(a) The range and kernel of a square matrix are of the same 
dimension. 

(b) There exists a 7 x 12 matrix whose rank is 10. 

(c) If two columns of a matrix are interchanged, then the rank does 
not change. 

(d) If a column of a matrix is multiplied by a ponzero scalar, then 
the rank does not change. 
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(e) The rank of an m x n matrix having r rows of only zeros is 
less than or equal to m — r. 



“1 2 3 4n 

I 

”1 0 on 

A - 

0 0 0 0 

.B =- 

2 0 0 


._0 0 0 Oj 


r 

o 

o 


(f) The kernel of A is 2-dimensionaI. 

(g) The kernel of Jl is 2-dimensional. 

(h) The ranks of A and B are the same 

5.6 TRANSPOSE OF A MATRIX AND SPECIAL 
TYPES OF MATRICES 

In this article the matrices involved may be considered rjal or complex. 
Let vibe an m x « matrix (a„). Writing the rows of A as columns 
(and therefore the columns of A as rows), we get a new matrix called the 
transpose of A, which is denoted by A’’’. Actually, the ifth element of 
is at,{, as can be seen from the details of the following entries ‘ 


an 

ai2 •• 

. aj, ... 

am 1 

I 

a2i . 

. ayi . 

• ani 

«« 

*22 •• 

. a^, .. 

«2n 

1 

ai2 

a22 • 

. a , 2 . 

.. a „2 


a, 2 •• 

. ay, .. 

. ay„ 

, AT ^ 

ai, 

aj, .. 

.. ay, . 

•• 

• 1 

-ami 

am2 • 

.. a^, .. 

• ^mn-. 



a2n . 

• • ^'jn • ' 

1 

" a^^ — 1 


Clearly, ^4'' is an w x ni matrix whose y-th element is ihe ji-th 
element of A. It follows immediately from the definition of transpose that 
/J ~ In and O^Xn ~ OnXffi* 

5.5.1 Theorem If A and B are two m x n matrices, then 

(a) {A + BV ^ AT -\- Br, 

(b) (aAY = ail’’, and 

(c) (AT)T = A, 

The proof is straightforward and left to the reader. 

5.6.2 Theorem If A is an m x n matrix and B is an n x p matrix, then 
iAS)^ = B^A^. 

Prtof : First, note that AB is defined and is an m x p matrix. So 
(ABY is a p X n matrix. Again, i4r is an n x m matrix and Bf is a 
p X n matrix. Therefore, we have p X m matrices on both side$ of the 
equality in the theorem and so the equality is meaningful. 
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To prove that the equality holds, it sufiSces to prove that the ij-\h 
element of (AB)^ is equal to the ly-th element of Let A ~ (a^)mxn 

and B = Then A^ and Br = (po),x*, where 

= ct/i and = Prt — The ij-th element of BM^ is 

A-=l *■=! 

which is the yV-th element of AB and hence the (/-th element of (AB)^. 
Thus, (AB)r - B 

5.B,3 Theorem If Aha nonsingular square matrix, then A’’’ is also non- 
singular and (A^~^ == (A~^y. 

Proof : Since A is nonsingular, there exists a matrix B such that 
AB = I — BA. Therefore, 

{ABf ^IT=: (BA)r . 

This gives B^A^ — I -- A B^ Therefore, A has the inverse, namely, 
B^, and (Ar)-^ = Br ^ (A'Y, because B =- A'K | 

5.6.4 Corollary The columns of a square matrix A are u iff its rows 
are li. 

Proof' Columns of A are u A is nonsingular (Theorem 5.5.2) 
A is nonsingular (Theorem 5.6.3) columns of Ar are u (Theorem 
S.5.2) rows of are u (definition of Ar). | 

We shall prove in Theorem 5.7.5 that in any matrix, not necessarily 
square, the maximum number of linearly independent columns is the same 
as the maximum number of linearly independent rows. 

Before we conclude this article let us familiarize ourselves with certain 
special types of matrices. 

A square matrix of the form 

0 0 ... 0 0 “1 

0 X, 0 ... 0 0 

0 0 Xa ■ • 0 0 


LO 0 0 .... 0 X, J 

is called a diagonal matrix. In other words, A = (an)nxn is R diagonal 
matrix if an — 0 whenever i^^J* i-e. an — X^S^. 

A square matrix of the form 
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“A 0 ... on 

0 A ... 0 


= A/ 


0 0 ... A 


is called a scalar matrix. In other words, A — (attilnxn is a scalar matrix 
if Xu = A8</ for a fixed scalar A. 

A square matrix of the form 

“«11 «1* *18 — « ln “ 

0 OCjj a23 ... ajn 

0 0 aj3 ... a,„ 


LO 0 0 ... a,«J 

is called an t^per triangular matrix. In other words, A = (xM),ixn >s an 
upper triangular matrix if xu = 0 whenever i > j. 

A square matrix of the form 


L 

0 

0 

r 

o 


a22 

0 

... 0 

aai 

*32 

*38 

... 0 

Lam 

am 

««3 

• 

••• ^nn — 1 


is called a lower triangular matrix. In other words, A — (vo)nxn is a lower 
triangular matrix if a„ = 0 whenever i < J. 

A square matrix A is said to be idempotent if A* = A. 

A square matrix A is said to be symmetric if A = i.e. xu = xu for 

all/,y. 

A square matrix A is said to be skew-symmetric if A — —A , i.e. 
Xif «= —Xfi for all i,J. 

If A = ixtf)mxn> the matrix B — (s.u)axn^ where the bar denotes 
complex conjugation,- is called the conjugate of A. It is denoted by A. 

The matrix (A)^ is called the transposed conjugate of A. It is denoted 
by A*. Obviously, (A)*" = (AO. 

A matrix A is said to be Hermitian if A => A*, i.e. if xu ^ It is 
said to be skew-Hermitian if A => —A*, i.e. »» — For example, 
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r 0 n r 1 i-n 

I I and I I are Hermitian matrices 

L-/ OJ LI + i 2 J 

ro in 

and I I is a skew-Hermitian matrix. 

U OJ 

From these definitions of special matrices, we get the following results : 
(i) The product of two diagonal matrices of the same order n is again 
a diagonal matrix of order n and 


0 ...on 


-(lx 0 ...on 

XiHx 0 ... 0 

0 Xj ... 0 


0 (I 2 ... 0 1 

i "" 

0 Xjjig 0 

_0 0 ... X„J 

1 

. : . 1 

_o 0 ... (i„j i 

_ 0 0 ... X„(1„_ 


(ii) Any two diagonal matrices of the same order commute with each 
other. 

(iii) A diagonal matrix is nonsingular iff none of the diagonal entries is 
zero. 

(iv) The inverse of the diagonal matrix 


rxi 0 ...on 


ri/Xi 0 .. on 

0 

0 

IS 

0 

0 

: I i 


• • • 

_0 0 ... X„_ 


r 

0 

0 

L_ 


A, 0, r == 1, 2, .... n. 

(v) The transpose of an upper (lower) triangular matrix is lower 
(upper) triangular. 

(vi) In a skew-symmetric matrix all the diagonal entries arc zero. 

(vii) In a Hermitian matrix all the diagonal elements are real. 

(viii) Multiplication of a matrix A by the scalar matrix X/ is equivalent to 
multiplication of A by the scalar X. 

Problem Set 5.6 


1. Prove Theorem 5.6.1. 



r 1 2 3“ 

r 

7 

0 

L 


- 1 

n 

2. A = 

r 

1 

1 

L3 -1 2J 

.c- 

1 

1 

_-2 

-1 

3j 
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-1 -n r-i 1 on 

Z)=» 2 0 ,£= 2 0 i 

_3 2J L 1 1 3 

For these matrices, evaluate the following : 

(a) AT (b) (c) AB^ (d) {CB)T (e) (f) BA^ 

(g) CJBr (h) B+ DT (i) (C + D)T. 

3. For the matrices in Problem 2, verify the following : 

(a) (A + EV^ ATT + ET (b) {D^iC + -= (C^ + B)D 

(c) (3C + SD)r = 2Cr + 5DT (d) (AC)T = C^A^ 

(e) {CD^yr^^DCr. 

4. For m X n matrices A, B, and C, prove that 

(a) iAB^T = jB4T (b) (A^ByT^ = B^A 

(c) ({A + Bycryr =. c(A^ + B^ (d) {(A ^ Byrcyr == CT{A + By 

5. Determine A * for the matrix A in the following : 

r 1 + / 3 - n ri - <■ 2 - 3/ 1 + / n 

(a) l I (b) I I 

L-1 - / 2 - ij L2 + / 1 + 4| 3 - 2/J 


(c) 


-2 -1- 3/ 

2 - i n 

r 1 

1 - / 2i - 1 n 

1 - 2i 

2 - 2/ (d) 

2—1 

i —1 

_3 + 4» 

2 -f 1 J 

LI + 1 

2 -1- / 3 + 2/J 


a h gl 

6.. If^== h b f and — (x,^, z), evaluate A'/4A'^. 

Lg / c_ 

7. If i4 is an m X n matrix with complex entries such that AA* = 0, 
prove that A — A — Q. 

8. If A and B are square matrices of the same order and A is symmetric, 
prove that B^AB is also symmetric. 

9. (a) Prove that a triangular matrix whose leading diagonal entries are 

all zeros is nilpotent. 

(b) Determine a matrix that is both upper and lower triangular. 

10. Let >1 be a square matrix. Then prove that 

. (a) i4 + A* is Hermitian. 

(b) A — il* is skew-Hermitian. 

11. (a) Prove that every square matrix can be expressed as the sum of 

a Hermitian and a skew-Hermitian matrix. 
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(b) Prove that every square matrix can be expressed as the sum of 
a symmetric and a skew*symmetric matrix. 

12. Piove that the set of all n X n diagonal matrices is a subspace of 

*• 

13. Prove that the set of all n x n invertible diagonal matrices is a group 
under multiplication. 

14. True or false ? 

(a) The set of all n x n diagonal matrices is a group under multi- 
plication. 

(b) If A IS mvolutory, then its transpose is also involutory. {A is 
involutory means A^ - I.) 

r 0 12“ 

(c) The matrix - 1 0 3 is skew-symmetric. 

i_-2 -3 1_ 

(d) Every syinmelric matrix is Hermitian. 

(e) A nonzero idempotent matrix is not nilpotent. 

(0 An idempotent matrix A is singular unless A — 1. 

5.7 ELEMENTARY ROW OPERATIONS 

In this article we shall study certain operations on a matrix that help us 
to determine as rank. First, we start with the familiar method of solving 
a system of simultaneous linear equations in three unknowns. 

Two systems of (simultaneous) linear equations are said to be equival- 
ent (in symbols, ♦> ) if they have the same set of solutions. 

Let us solve the system 


2x — 3y + r = — 1 

3x + Oy + z — 6 . 


(A) 

X + 2y — 2z = —1 

Interchanging the first and third equations, we get the system 


A* + 2y -2z= -1 


(El) 

3a + Oy -f z = ' 6 


(E2) 

2a — 3y -f z = — 1 


(E3) 

^ (El) : A + 2y - 2z = 

-1 

(E4) 

(El) X (-3) -f (E2) ; Oa - 6y + Tz = 

9 

(E5) 

(El) X (-2) -f (E3) : Oa - 7y + 5z = 

1 

% 

(E6) 

(Et) ; A -f 2y - 2z = 

-1 

(E7) 

(E5) X (-t) : Oa + y - iz » 


m 

(E(i) ; Oa - 7y -f 5z = 

1 

(E9) 
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(E7) : x + 2y- 

2 z = 

-1 

(ElO) 

(E8); 0x+ y- 


-I 

(Ell) 

(E8) X (7) + (E9) Ojf -f- Oy - 



(E12) 

(ElO) : X + 2y - 

2 z = 

-1 

(E13) 

(Ell) Ox-f y- 

fz == 

-1 

(E14) 

(E12) X (— iV) Ox + Oy + 

z = 

3 

(El 5) 

(bl3): lx + 2y- 

2z = 

-1 

(El 6) 

(E15) X (J) + (E14) : Ox + ly + 

Oz = 

2 

(El 7) 

(EI5) : Ox 4- Oy 4- 

Iz =- 

3 

(E18) 

(E17) X (-2) + (E16) lx 4- Oy - 

2z = 

-5 

(E19) 

(E17) : Ox 4 ly 4- 

Oz = 

2 

(E20) 

(E18) Ox 4- Oy 4- 

Iz = 

3 

(E21) 

(E21) X (2) + (E19) 'lx 4- Oy 4- 

Or == 

1 


(E20) Ox 4- ly 4- 

Oz = 

2 

(B) 

(E21) Ox 4- Ov 4- 

Iz = 

3 



which gives jc = I, y = 2, and z = 3. 

It can be seen that throughout we have worked with only the coeffi- 
cients in the equations and the numbers on the right-hand side. The pre- 
sence of the symbols x, y, and z and the sign of equality does not at all 
affect the working. Now, deleting the symbols x, y, and z and the sign of 
equality from the pattern, which otherwise remains unchanged, we shall 
write only the numbers involved in the form of a matrix A. Repeating 
the foregoing sequence of steps, we get the following sequence of matrices, 
where the symbol is an analogue of the symbol «», and the letters r^, r^, 
and fa stand respectively for row 1, row 2, and row 3. Further, r, -f kr/ 
means ‘add k times the y-th row vector to the Hh row vector’ . We have 



r2 -3 1 ~n 


-1 

2 -2 -1“ 


1 





matrix A 

= 

3 0 16 

interchange 
ri and r. 

3 

0 1 6 



Ll 2 -2 ~IJ 

_2 

-3 1 -1_ 



ri 2 -2 - 1 - 


-1 

2 -2 -1- 

ft + (-3)»‘x 
and 

0-679 

rt X (-i) 

0 

1 -i -* 

r, 4- (-2)r, 

LO -7 5 IJ 


_0 

-7 5 IJ 


n 

2-2 -in 

1 


ri 

2 -2 -1“ 

't + 7ri 

0 

•— 

1 

1 

r, X (-A) 

0 

1 -i -1 

1 

lo 

0 -V -¥J 


.0 

0 1 3_ 
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fi + ifi 


•'i 4 2r3 


ri 

2 

- 

-2 

-n 

1 

n 

I 

0 

-2 

5“ 

0 

1 


0 

2 ' 

'’i 4- (- 

o 

1 

1 

0 

2 

_o 

0 


1 

3J 

LO 

0 

1 

3_ 

-1 

0 

0 

1“ 






0 

1 

0 

2 

- matrix B. 





1 0 

0 

1 

3 1 

1 






1 he systems (A) and (B) have the same solution, because one has been 
obtained fiom the other by certain operations that do not affect the 
solution set. The same operations when rerformed on the rows of matrix 
A produce matrix S. These operations are called elementary row 
operations. They are of three types : 

Type I Interchanging two rows. 

Type II Multiplying a row by a non/ero scalar. 

Type III Adding to a row a scalar-times another row. 

5 7.1 Definition When a matrix A is subjected to a finite number of 
elementary row operations, the resulting matrix B is said to be 
row~equivalent to A. We write this as B ^ A. 

A moment’s thought will show that is an equivalence relation. 

5.7.2 Definition 1 he row rank of a matrix A is the maximum number of 
linearly independent row vectors of A. 

5.7.3 Remark In this sense the rank of a matrix A, defined in § 5.5, must 
be called the column rank of A. But ultimately (see Theorem 5.7.5) 


0 U 2 0 2 0 2 0 0 0 0 

0 0 0 1 -1 0 3 0 0 0 -2 

0 0 0 0 0 1 0 0 0 0 2 

00000001 000 
00000000 _1 0 4 

000000000 1 2 

00000000000 
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we shall prove that for any matrix A the column rank is equal to the 
row rank; so we can afford to call both of them simply *rank’. Till 
then,' we shall have to distinguish between the row rank defined in 
S.7.2 and the rank (= column rank) defined in § S.5. 

The aforesaid process of obtaining matrix B from matrix A is called 
the process of row reduction. In practice «e usually aim at getting ^ in a 
standard form called row-reduced echelon form. 

Consider the following 7x11 matrix and the ‘stairs’ or ‘steps’ marked 
therein : 

Such a matrix is said to be in row-reduced echelon form. We shall 
now give its precise definition. 

5.7.4 Definition A matrix is said to be in row - 1 educed echelon form 
satisfies the following criteria : 

(a) The first nonzero entry tn each nonzero row is 1. 

(b) If a column contains the first nonzero entry of any row, then 
every other entry in that column is zero. 

(c) The zero rows (i.e. rows containing only zeros) occur below all 
the nonzero rows. 

(d) Let there be r nonzero rows. If the first nonzero entry of the 
i-th row occurs in column k, (» — 1, 2, ..., r), then 

<1 ••• kf. 

Draw horizontal and vertical partition lines such that below and left 
of these lines there are only zeros and such that at the point where the 
vertical line is followed by a horizontal line there are 1 ’s, namely, the first 
nonzero entries of nonzero rows. These turning points are called steps. 
See the foregoing 7x11 matrix, where there are s'x steps. 

We now state the main theorem of this article. 

5.7.5 Theorem (a) The tow rank and column rank of a matrix A are the 
iame. In other words, the maximum number of linearly independent 
row vectors is equal to the maximum number of linearly independent 
column vectors and is equal to the rank of the matrix. 

(b) The rank of a matrix A is the number of nonzero rows in its row- 
reduced echelon form. 
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We shall prove th's theorem by establishing a succession of lemmas. 
The sequence of proof can be easily understood from F’gure 5.1 : 

Row ronk of A Column rank of A 



Row rank of B ITU Column rank of B 

% by Lcrrma 5 710 



Number of ZIZZ Number of 
nonzero rows steps 

of B in B 


A. Given matrix 

B: Row reduced echelon form of A (Lemma 5.7 6) 
fri 54 

Figure 5.1 

5.7.6 Ivemma Every matrix A is ro^ -equivalent to a row-reduced echelon 
matrix. 

In other words, every matrix can be reduced to the row-reduced 
echelon form by a finite sequence of elementary row operations. 

We shall omit the proof of this lemma, as careful scrutiny of the 
process of row reduction will convince the reader that this lemma is true. 

5.7.7 Lemma If a matrix is in the row- reduced echelon form^ its row rank 
is the number of nonzero rows in it. 

The proof is left to the reader. 

5.7.8 Lemma The row rank of a matrix A is equal to the row rank of the 
row-reduced echelon matrix B, obtained from A. 

Proof: B has been obtained from i4 by a finite sequence of 
elementary row operations. We .shall show that these row operations do 
not affect the row rank of A. It is clear that the row operations of type 
I and type II do not alter the row rank (see Problem 4, Problem Set 5.5). 
It is therefore enough to prove that an elementary row operation of type 
III does not change the max'mum number of linearly independent row 
vectors. Suppose we gd^ a-times a row vector to mother row vector 
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Vj. Let ihe other row vectors be Vj, V 4 , , v„. Exam'ne the two sets of 

vectors . 

P = (v,, Vg, Va} and Q = {rj, j '2 + *’’i» *' 3 * •••» ’’m/ • 

It can be easily checked that ( 1 ) if /* is li, then 0 is also Ll and (ii) if P is 
LD, then Q is ld. This shows that a type III operation docs net affect the 
maximum number of linearly independent row vectors, and so the row 
rank is unaffected by such an operation (sec Problem 9). | 

5.7.9 Lemnu If a matrix is in the row-reduced echelon form, then its 

(column) rank is the number of steps' in it. 

• 

Proof : Let the number of steps be p. Every column that occurs 
before the first step is a zero vector, and every row that occurs after the 
last step is also a zero vector. So the nonzero column vectors can be 
considered vectors in F,. Therefore, the column rank is less than or equal 
to p. On the other hand each step contributes one nonzero column 
vector. The set of these column vectors is li. This means the column 
rank is greater than or equal to p. Thus, the column rank is p. | 

5.7.10 Lemma If a matrix is in the row-reduced echelon form, then its 
(column) rank is equal to its row rank. 

Proof : Note that the number of steps in such a matrix is equal to 
the number of nonzero rows. Using lemmas 5.7.7 and 5.7.9, we find that 
its (column) rank is the number of sieps in it, i.c. the number of nonzero 
rows, i.e. its row rank, g 

5.7.11 Lemma The (column) rank of a matrix A h equal to the (column) 
rank of the row-rcduced c chelon matrix B, obtained from A . 

Proof : To facilitate understanding cf this lemma, we shall prove 
it for a matrix cf oider 3x4. By using proper notations, the same 
proof can be extended to any m x n matrix. 

We have only to prove that the thiec types of elementary row 
operations do not affect the column lank. The fact that types I and II 
operations do not aftect the column rank is easy to prove and is left to the 
reader. To prove that a type III operation does not affect the column 
rank, consider the matrix 

\ aji aj2 ai3 ai/l 
<3^22 ^'28 *24 

*32 *33 *34-J 

Let us perform a type III operation on P, namely, let us add a-time$ row 
3 to row 2 . The resulting matrix S be 

*11 *18 *13 *14 

Q — «S1 + ««8l “S3 + “*3S “S3 + ““33 “S4 + ““s* • 

*|l *»S “,8 « 
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Suppose the column lank of P is 3 (any other value of the rank can be 
handled analogously). Then in P there exist three linearly independent 
column vectors and every four column vectors are ld. We shall prove 
that the same phenomenon occurs in Q also. 

Let the three linearly independent column vectors of P be the first three 
(if they are any other three, they can be brought to the first three positions 
without affecting the argument). Let us call them Ci, C„ and C,. 

If ^ 2 . and P3 are the first three column vectors of Q, then the vector 
equation + PjPj + PjPj = 0 gives 

Pl«ll + ^2*13 + Pa «13 = 0 
"h ®®3i) "h "i", fl'^aa) "h Paf^'aa + **33) — 0 

+ P3«3a + Pj«33 = 0 • 

Adding ( — a)*times the third equation to the second equation, we get 
the equivalent system 

Pi's'll h Pa*i 2 + Pj*i3 ~ 0 

Pi*2i "t" Pa^aa "h P3*2s ~ 0 
Pi*ai "1 p2*3a ^ Pi*33 ~ ® • 

This system is nothing but the vector equation PiCi + p^C, +,P 3 C 3 = 
0. Since C,, Cj, and C, arc Li, we get p^ = 0 = p^ = pj. Thus, Fj, F„ 
and F, are li. 

Again, we prove that when and Cf arc LD, then automati* 

cally Fi, Fi, F 3 , and'F^ are also ld. 

The vector equation p,Fi 4 P 3 F 2 4 PaF* [ P4F4 = 0 gives 

Pl*U + P3«ia 4 P3«13 + P*«M = 0 

• Pi(«ai 4 - ««3i) + PiC^aa ^ ^ Ps(«a3 1 ““as) + PiC^aa + “* 34 ) == 0 

Pl®Jl 't“ Pa^sa P3*33 "I" P4*34 ~ 0 • 

Adding (— a)-times the third equation to the second equation, we get 
an equivalent system which is nothing but the vector equation p^Ci 4- PiCt 

4- p 3 C 3 4 - P 4 C 4 = 0. 

Since Ci, C^, C3, and C4 are ld, at least one P is not zero. Hence, Fj, 
F 2 , F3, and F 4 are ld. 

Thus, we see that the type III operation does not affect the column 
rank of matrix P. Q 

Proof of Theorem 5.7.5 (a) let B be the row-reduced echelon 
form of A. Then 

row rank of A — row rank of B (Lemma 5.7.8) 

= column rank of B (Lemma 5.7.10) 

= column rank of A (Lemma 5.7.11). 

(b) Rank of A = column rank of A (Remark 5.7.3) 

— row rank of A (part (a) of this theorem) 

= row rank of B (Lemma 5.7.8) 

4= number of nonzero rows in B (Lemma 5.7.7). | 
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5.7.12 Conlbuj An n X n matrix A is nonsingular iff its row-t educed 
echelon form is /„. 

Proof : Let the row-reduced ecbeJon form be /«. Clearly, its 
column vectors are tr. So the rank of /„ is n. Hence, by Lemma 5.7.1 i, 
the column rank of A is n, i.e. column vectors of A are Li. Therefore, by 
Theorem 5.5.2, A is nonsingular. 

Conversely, let A be nonsingular. So the rank of is n. Therefore, 
the row-reduced echelon form £ of A will have n linearly independent 
column vectors (Lemma 5.7.11). Since the number of columns in B is n, 

it follows that 5 = /„. | 

Example 5 22 Determine the rank of the matrix 

r I 2 -1 on 

I 

-13 0-4 

A = 

2 1 3-2 

L 1 1 1 -1_ 

by reducing it to row-reduced echelon form 



“ 1 

2 

-1 

on 


"1 

2 

-1 

on 


-1 

3 

0 

-4 


0 

5 

-1 

-4 

A = 



»‘2 + 'U 





2 

1 

3 

-2 

1 1 

0 

-3 

5 

-2 


_ 1 

1 

1 

-IJ 


_0 

-1 

2 

-IJ 


“1 

2 

-1 

on 


-1 

2 

-1 

on 


0 

-1 

2 

-1 


0 

1 

-2 

1 

inter- 





changing 
it and ri 

0 

-3 

5 

-2 

ra X (-1) 

0 

-3 

5 

-2 


_0 

5 

-1 

-4J 


_0 

5 

-1 

-4_ 

i 

“1 

2 

-1 

on 


-1 

2 

-1 

on 

r>»J 

0 

1 

-2 

1 


0 

1 

-2 

1 

'a + -r*, 
r t - 5r, 

0 

0 

-1 

1 

ft f 9r3 

0 

0 

.-1 

1 


_c 

0 

9 

-9J 


_0 

0 

0 

oj 

1 

n 

2 

-1 

on 


n 

2 

0 

-1” 


0 

1 

-2 

1 


0 

1 

0 

-1 

r, X (-1) 

0 

0 

1 

-1 

rt + 2r„ 

n + r. 

0 

0 

1 

-1 


^0 

Q 

9 



..0 

0 

0 

0^ 
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ri - 2r» 


1 

0 

0 


0 

1 

0 


0 1 - 
0 -1 
I -1 


0 0 0 0 
Hence, the rank of A is 3. 


Recall the explanation at the beginning of this article. The row reduc- 
tion process is just an abstract imitation of the elimination method we 
adopt in solving simultaneous linear equations, except that we now do it in 
an organised way. The row reduction worked out in Example 5.22 is there- 
fore also the method of solving the system 

X 2y -- z ~ 0 

-x 4- 3y = -4 
2x y + 3z ~ —2 

* + y + z = — 1 , 

giving the solution x ~ I, y -- —i, z - —1. 

This takes us to the subject of the solution of a system of linear equa- 
tions, which we shall deal with in § 5.8. ' 


Problem Set 5.7 

1. Reduce the following matrices to the row-reduced echelon form : 



“1 

- 

-1 

1” 




r3 


2 


3 


1" 


(a) 

3 

- 

-1 

2 



(b) 

4 


3 


5 


2 



_3 


1 

1_ 




L2 


1 


1 


0_ 










n 


3 


2 


on 



-1 


2 

3 

4 

-in 

1 


2 


0 


1 


1 


<c) 

4 


1 

5 

-6 

10 

(d) 

) 


2 


3 


0 



L2 


0 

2 

-2 

6J 

1 
















L_3 

- 

-1 


0 


ij 



r- 

1 

1 

1 


on 


n 


2 


0 


on 


(e) 


1 

- 1 

1 


1 1 

1 

(f) 

1 


1 

— 

-1 


2 


L 

0 

1 

2 

\ — 

1 

1 


^0 


2 


1 

. 

-i_ 





1 

1 

C 

1 - 

2J 








' 


r3 

1 


1 

-n 

1 



r 

0 


6 


6 

in 

1 


1 


2 

3 






8 


•7 


2 


j 

(g) 







(h) 




• 


1 



4 


0 

1 




— 

-3 


2 


1 




$ 

3^ 





1 


1 

- 

-1 

1 

5J 
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ri 0 7 9n 

S 2 2 10 

(0 

3-2 3 11 

_2 -1 3 8J 

2. Determine the column rank of the matrices in Problem 1 by two diffe* 
rait methods. 

3. Determine the row rank of the matrices in Problem 1 by two different 
methods. 

4. Determine which of the square matrices in Problem 1 are nonsingular 
and in each case find the inverse. 

5. Solve the following systems of linear equations by using the row- 
reduction method : 

(a) 7x-3y =1 (b) y-2z = 3 

2x- y-\- z- 2 3x+ z = 4 

3x + y — 2z— 1 X + y + z - I 

(c) X — y + z = 0 (d) ac — y + 3z = 1 

2x + y — 3z— 1 2* + y— z — 2 

— Jf+ 3 ' + 2z=:— 1 3x — y + 2z-=2 

(e) x+ y-2z= 3 

3ac + y — z = 8 

2x — y + z = 0. 

6. Prove that is an equivalence relation. 

7. In the 7 x 11 matrix on p. 187 find the numbers ki, .. , kr of 
Definition 5.7.4. 

8. Prove Lemma 5.7.7. 

9. Write down the details of the proof that the row operation of type III 
does not affect the row rank of the matrix. 

10. True or false 1 

(a) For any matrix A, the ranks of A and are the same. 

(b) The row-reduced echelon form of a diagonal matrix A is A itself. 

(c) Every upper triangular matrix is row equivalent to a diagonal 
matrix. 

(d) There exists a 12 k 7 matrix of rank 10. 

(•) The row-reduced edwlon form of a symmetric matrix is also 
symmetric. ^ 

(f) The type III operation performed on the columns of a matrix 
Ifqves its rank unchanged. 
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5.8 SYSTEMS OF LINEAR EQUATIONS 


lo this article we shall study the general system of m linear equations in 
n unknowns. 

+ ... + IttnXn == bi ' 

0*1*1 + + ... + Oj,** -b, [ 

r • (NH) 

“«1*1 + «M»** + ••• + am«*n = i 


This iSHxUled a nonbomogeneous system (NH) if at least one 5{ is not zero. 
The associated homogeneous system (H) is 


«ii*i + oijx, + ... 4 «i«a:„ = 0 
OjiJCi 4 oj 2*2 H ... 4 Ojfijfn = 0 


*ml*l + ««IS*2 + = 0 



These systems can be written in matrix notation as 
Ax = b (h ^ 0) 

and Ax — 0 , 


(H) 


*11 *18 ... *ln 


where 


A = 


0*1 «»* 


I — 0ml Ont2 


* 2 » 


amn-J 


X = (Xi, Xi G V„, and b = (bi, b*, ... , b„)^ G Vm- 

This operator equation is to be solved for x. The matrix A is called 
the cotfficient matrix of the system. The matrix obtained by adjoining the 
column vector b, at the end, to the matrix A, is called the augmented matrix 
of the system (NH) and is denoted by (A, b). As usual, we consider A a 
linear transformation from to V„. By Theorem 4.8.1, we have 

(i) Ax = b has a solution iff b & range of A. This is equivalent to 
saying (cf § 5.5) that b G span of the column vectors of A. In other words, 
A and the augmented matrix (A, b) have the same rank. 

(ii) If i4x = h has a solution, then the solution is unique iff Ax = 0 
has the trivial solution x — 0 as its only solution. This happens iff the 
kernel of A is {0}, i.e. iff nullity of A is zero. This is equivalent to saying 
that the tank of ^4 is it. 


Thus, we have proved the following theorem. 

5.8.1 Thewem (a) (Existence) The system (NH) has -a solution ^ the 
matrix A and the augmented matrix (A, b) hare die same rank. 

(b) (Uniquenm) ff the system (NH)hor a sohdiont then the sobt- 
tfoa is tadque ^the rank ef A is equal to n. 
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This theorem and Theorem 4.8. improperly interpreted for our systemsr 
of equations (NH) and (H>, give the following comprehensive theorem. 

5.8.2 Theorem Consider the systems of equations (NH) nnd(H). Let the 
rank of A be r. Then 

(a) (NH) has a solution iff (/4, b) has rank r. 

(b) Jf r m, then (NH) always has a solutioUm whatever may be b 

(c) If r - m ^ n, then (NH) has a unique solution^ whatever may 
be b & V,n\ nnd further (H) has a unique solutionm namely ^ the trivial 
solution. 

(d) If r m < «, whatever may be b E. (NH) as well as (H) 
have an infinite number of solutions. In facty r of the unknowns can 
be determined in terms of the remaining (n — r) unknowns^ whose 
values can be arbitrarily chosen. 

(e) In the cases (i) r < m -- n, (li) r. < m < n^ and fiii) r < n < 
m, if (NH) ha^ a solutionm then there is an infinite number of solutions. 
In Jactm r of the unknowns can be determined in terms of the remain- 
ing (n — r) unknowns, whose values can be arbitrarily chosen. Furtherm 
(H) has an infinite number of solutions. 

(f) In the case r — n < m, (H) has a unique solution, namely, the 
trivial s hit ion, and //(NH) has a solution, then that solution is unique. 

(g) Jf m *— w, (H) has a nontrivial solution iff A is singular. 

Proof : Parts (a) and (f) arc only restatements of Theorem 5.8.1. 
They are included here for completeness. Part (b) follows, since r = m 
implies the range of A is Part (c) follows from part (b) and Theorem 
5.8.1 (b). Now we have to prove only parts (d), (e), and (g). 

To prove part (d), first note that, since r ~ w, the range of A is 
and so every b E Vm i^as an A pre-image in Vn. The kernel of A has the 
dimension n — r > 0. So the kernel being a subspace, has an infinite 
number of vectors in it. By Theorem 4.8.1, it follows that the solution set 
of (NH) is a translate of K. So it also has an infinite number of vectors. 
The fact that r unknowns can be determined in terms of the remaining 
(n — r) unknowns can be seen from the row reduction process of A (see 
Example 5.23). 

To prove part (e), note that the proof is the same as that of part (d), 
except that, first, we should know whether there exists a solution. Once 
the solution exists, the rest of the argument is the same. 

Finally, part (g) follows from parts (e(i)) and (c) once we recall that an 
n X n square matrix is singular iff its rank is less than n. | 

The result of this theorem can be presented as in Table 5.1. 

Let the rank of matrix Ahc r and that of the augmented matrix (A, b) 
be ri. Further, let the rank of the kernel be k == n — r. Obviously, r < 
ri, r < m , r < If. (Numbers within brackets refer to the parts of 
Theorem 5.8. 2.) 
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Table S.l 


The system has no solution (a) 

The system has a solution and the following hap- 
pens . (a) 

Homogeneous system Nonhomogeneous sys- 
(H) ^ ^ tem (NH) 

— 0 1 ) -^0 


r = n, k 0 has only the trivial has the unique solu- 
solution (c) tion (c) 



lias infiniteljLmany sol- | has infinitely many 

utions Solution space solutions solution 

IS of dimension set is a linear variety 

n r < n, ^ whose base space is ot 

k n r^lj k = n — r (e(i)) j dimension k (e(i)) 

I We can find r unknowns in terms of the remain- 

I mg k ( n — r) unknowns, chosen arbitrarily (e) 



r — n, k — 0 has only the trivial sol- has the unique solution 
ution (f) (f) 


has infinitely many sol- has infinitely many sol- 
utions Solution space utions Solution set is 
IS of dimension a linear variety whose 

r n, base space is of dimen- 

= n — r'p\ k(-n — r) (e(iii)) sion fc (e(iii)) 

We can find r unknowns in terms of the remam- 
ing fc {= n — r) unknowns, chosen arbitrarily (e) 

has infinitely many sol- has infinitely many sol- 
utions Solution space utions Solution set is a 
IS of dimension linear variety whose 

(= R Rj) (d) base space is of dimen- 
_ „ Sion k (d) 


r — m, 

\k = n — m 


m<n 


We can find r (-=^ ri) unknowns in terms of the 
remaming k { - n ~ m) unknowns, chosen arbit- 
rarily (d) 


r < m, 
k ^ n — r 


has infinitely many sol- 
utions Solution space 
IS of dimension 

k(= n- r) (e(ii)) 

has infinitely many sol- 
utions Solution set is 
a linear variety whose 
base space is of dimen- 
sion k (c(ii)) 

We can find r unknowns in terms of the remain- 
ing fc n — r) unknowns, chosen arbitrarily (e) 
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Example 5.23 Consider the system 

2xi + Xi — x^ + == 2 

*1 + *8 — *4 + = 1 

12*1 + 2*8 + 8*8 + 2*8 = 12 . 

The augmented matrix (A, b) 


r 2 0 1 - 

1 

2-| 



ro 

0 

-1 

101 - 

1 

1 

ri - 

4*^ 

— 2r8, 

1 

0 

1 

L12 2 8 



fg 

- 2f* 




0 2 

12_ 



LO 

2 

-4 


ri 

0 

1 

-1 

1 


n 








1 

interchange 

0 

0 

-1 

1 

-1 


0 1 

ri<and r,, 
rgX i 

LO 

1 

-2 

6 

-5 


1 

OJ 


ri 

0 

0 

0 

0 


1“1 









fi + rg. 

0 

0 

-1 

1 

-1 


0 

r» - 2rg 

_0 

1 

0 

4 

-3 


0_ 


n 

0 

0 

0 

0 


1- 

r>mf 








interchange 

0 

1 

0 

4 

-3 


0 

rg and 

LO 

0 

-1 

1 

-1 

a 

0 _ 

1 

n 

0 

0 

0 

0 


n 


1 -1 on 
-1 1 1 
12 -10 Oj 


ri X (-1) 


0 


0 4-30 


LO 0 1-1 I OJ 

This shows 

*1 = 1 
X» + 4*8 — 3*8 = 0 
Xg— Af* + *8 == 0 . 

So *1=1 

*8 ”"^*4 “1" 3*5 

Xg = x^ — x^ • 

Rank of the cocflScicnt matrix i4 =*= 3 = rank of the augmented matrix. 
5—3 — 2 unknowns can be arbitrarily chosen. They are *4 and *8. Three 
unknowns *1, *8, and *, are determined in terms of *4 and x,. There is an 
infinite number of solutions. This is case (d) of Theorem 5.8.2. 

The set of solutions can be written as 

{(^* -J- 3*84 *4 Xf, Xf, *4) I *4, *8 ar^ arbitrary scalars} 

« {(1, 0. 0, 0, 0) + *4(0, -4, 1, 1, 0) + *8(0, 3, -1, 0, 1) I *4, *8 

are arbitrary scalars) 
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= (1, 0, 0, 0. 0) + ((0. -4. 1. 1, 0), (0, 3, -1. 0, 1)1 . 

It is a linear variety. Here (1, 0, 0, 0, 0) is one particular solution of the 
system and [(0, —4, 1, 1, 0), (0, 3, —1, 0, 1)] is the kernel ofthecoeflBcient 
matrix A of |j)ie system. 


Example 5 24 Consider the system 


Xi + 2t, + 4 jCs 

+ x* 

= 4 







- *s 

— 3*4 

= 4 






Xx - 

2aj 

- X, 


-- 0 




3*1 + 


- X, 

- 5*4 

= 5 

• 




The augmented matrix (A, b) 









“12 4 

1 

4n 

1 


n 

2 

4 

1 

4- 


2 0-1 

-3 

4 

^2 

0 

-4 

-9 

-5 

-4 

= 




fa ■ 

- fl. 







1 -2 -1 

0 

0 

fa - 

- 3ri 

0 

-4 

-5 

-1 

-4 


L3 1 -1 

-5 

5J 



LO 

-5 

-13 

-8 

-7_ 

I 

V 1 

-1 

2 

4 

1 

4n 






f. X (-i) 

0 

1 

a 

a 

4 

-1 - 

1 






0 

-4 

-5 

-4 



• 


1 

LO 

-5 

-13 

-8 - 

-7_ 






-\ 

0 

-i 

-1 

2- 





rw 




t 






Vi — 2rj, 

0 

1 

1 

1 





r, + 4r„ 
f* + 5r, 

0 

0 

4 

4 

0 






LO 

0 

_z 

— 4 

-i - 

-2_ 






“1 

0 

-i 

-i 

2n 






0 

1 

f 

4 

1 





r» X i, 

U X (-f) 

0 

0 

1 

1 

0 






_0 

0 

1 

1 

4 - 






ri 

0 

0 

-1 

2“ 










1 





r* + if*. 

0 

1 

0 

-1 





1 1 

• 

0 

0 

1 

1 

0 

• 




- 

_0 

0 

0 

0 

f- 


• 




The last row shows that 0*i + Oxi + Ox* + Ox* * 8/7, which is 
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absurd. Otherwise also it shows that the rank of ^4 is 3 and the rank of 
(A, b) is 4. (Why ?) So the system cannot have a solution. In other 
words, the equations are inconsistent. 

Problem Set 5.8 


1 . Determine whether the following systems of linear equations arc con- 
sistent. Discuss completely the solution in the case of consistent 
systems. 


:a) 

^ 1 — ^‘2 + 2X3 + 3x^ = 

1 

(b) 


4 2 xg 4 4x3 

+ 

4 


2Xy-\-2x^ + 2x^ = 

1 



- Xj 

+3^4= 

4 


4 xi- 4 - Xg - Xg - 

X4 = 

1 


Xi 

— 2X3 — Xg 

=s 

0 


Xi 42 Xi 4 3 .ra 

-- 

1 


3:^1 

1- -Xg— Xg 


7 

(c) 

2x^4 Xg — X4 


2 

(d) 


4 2 xg — X3 

- 2 ^: 4 = 

0 


Xi 4 X3 — X4 -f 


1 


2^1 

4 4x3 4 2 xa 

+4:x-4= 

4 


12 xi 4 2xj 4 8x3 4 

2x^ - 

12 


3xi 

4 6xg 4 3x3 

+6X4= 

6 

(e) 

Xi — .Xg 


1 

(0 


4 - 2x3 

= 

1 


2xi 4x34x3 

ir= 

2 


2 jfi 

4 Xg 4- 2x3 

=r= 

1 


Xg - X3 


3 



Xg — 2x3 


1 


Xi 4 x 34 Xa 

= 

4 



4 - Xg 

=: 

1 


2 xa- Xa 

=r- 

0 



1 

j- 

= 

1 


(g) 2xi ^ .Vj -\ x^ ^ 2 (h) -j 3:^2 — 3,X8 i lx^= 1 

3-*i - Xs - = 2 4xi + Xii - 2xj + 1 

Xi -l-2xa -Xa 4 x, =- 1 6xi f Sx* -^{-lOxa +3x«= 15 

^•^1 “f"^Xa "hXa 4 Xa = 5 “I 2xa 4 3xa 4 b 

(i) Xi-2xa-X3 =. -1 0) 3^1 + 4 3x3 46X4= 5 

2 xi -X, -3x4 = 1 xi + 2 xt- Xs -2x4=-! 

3 xi 4 Xa - x, -5x4. = 1 3 x, + 6x3 4 X3 42X4= 3 

2xi 4*3X3 4* X4 = 0 Xj + 2x3 4 2X3 44X4= 3 

(k) Xx -X3 -= 2 (1) 2xi + jTj 4 2x3 =1 

Xx 4 X342X3 =4 Xj 4 Xg = 0 

Xi 4 x,- 2 x, = 4 xi - 2x3 4 6X3 = 3 

Xi 4 Xg 4x, =4 x, — 2xj = 1 

Xi 4 3 x, -X, = 8 Xi - Xg 4 4 xa =2 

(m) Xi 4 X,- Xa-6X446X3= -19 (n) Xi - 3 xg 4 x* - X4= 7 

*1 47x4—7x3= 28 2xi 4 4 xg — Xa 46x4=— 6 

2X3 3X3418X4—4X3— 24 2 xx 4 Xg 4 X4= 0 

5.9 MATRIX INVERSION 

In this article we apply the method of row 'reduction to find the inverse 
of a nonsingular matrix. Let .4 be an n x n matrix, which is nonsingular. 
Then A-^ exists. Look at the equation Ax = b, where 6 # 0. To solve 
this we can proceed as follows : 
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Therefore, 

or 

or 

or 


Ax b . 
A-\Ax) = A-^b 
(i4-M)x - A-^b 
InX = Ar^b 
X A-^b . 


So, solving the equation Ax = b is equivalent to finding A'^b. But the 
solution of equations can be done by the process of row reduction. There- 
fore, the method of row reduction will also be adaptable to find Ar^b and 
consequently A~^. We can write the equation Ax = h as 

Ax = /.A . (1) 

Therefore A~^Ax — A~^I„b , 

i.e. /„x — A~^b . (2) 

Tn the process of reduction we always work from A and arrive at /„ 
(see Coro lary 5.7. 12). Equations (1) and (2) indicate that, if the same 
row reduction is applied to /», the identity matrix, then we end up with the 
matrix A~^ on the right-hand side of (1). Thus, we have the following 
method of inverting A. 


Perform a sequence of elementary row operations on A so that it 
reduces to /„ Perform the same sequence of elementary row operations 
on the matrix The resulting matrix is A’^, 

In practice, we perform the sequence of elementary row operations on 
A and I„ simultaneously, keeping them side by side as illustrated m the 
following example. 

Example 5.25 Invert the matrix 


A 


n 1 
1 -1 
_i -1 


0“ 

1 

2 _ 


Note Whether the matrix is nonsingular or not will also be clear by the 
process of row reduction. If the final matrix has all its rows nonzero, then 
the original matrix should be nonsingular. (Why ?) 

We write the 3x3 matrix A and the matrix /« side by side and 
obtain a 3 x 6 matrix with a vertical line separating the entries of the 
matrices A and /s as shown below. Then we perform the elementary row 
operations on this 3x6 matrix in such a way that the entries on the left- 
hand side of the vertical line ultimately form 1^. The entries on the right- 
hand side of the vertical line then give the required inverse of A. The 3x6 
matrix used here is called the enlarged matrix of A. '' 


“1 1 0 

1 

0 

on 

1-1 1 

0 

1 

0 

LI -1 2 

0 

0 

i_ 
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Hence, 



n 

1 

0 


1 

0 

( 

5- 


1 







- ri. 

0 

-2 

: 1 

— 

1 

1 

0 

r, - r, 









_o 

-2 

2 

— 

1 

0 

IJ 


“1 

1 

0 

1 


0 

0“ 











rt X (-i). 

0 

1 

-i 


— 


0 


r, X (-i) 










_0 

1 

-1 

i 


0 - 

-i- 



ri 

1 

0 

1 


0 

on 










- r. 

0 

1 

-i 

i 

— 

1 

0 



_o 

0 

' -1 i 

0 


i - 



n 

1 

0 

1 


0 

on 


^ 1 









r, X (-2) 

0 

1 

-1 

i 


1 

0 



LO 

0 

1 

0 

— 

1 

1 

ij 


n 

1 

0 

1 

0 

o~ 



0 

1 

0 

i 

- 

1 

} 



-0 

0 

1 

0 


1 

i_ 



“1 

0 

0 

h 


1 - 

■n 











ri - Ta 

0 

1 

0 

1 


1 


• 


_0 

0 

1 

0 

— 

1 

i_ 





1 - 

n 

I 



A-^ 

= 

i -1 

4 






Lo 

1 

IJ 




The reader is advised to check that A A ^ is indeed 7, and so also is A~^A. 


Problem Set 5.9 


1. Using the row reduction method, determine which of the square 
matrices of Problem 1, Problem Set 5.5, are nonsingular and in each 
of these cases find the inverse. 

2. Repeat Problem 1 for the matrices of Problem 2, Problem Set 5.5. 

3. Repeat Problem 1 for the square matrices of Problem 1, Problem Set 
5.7. 



Chapter 6 


Determinants 


6.1 DEFINITION 

We start with some preliminaries on permutations of the set {I, 2, 
n}. 

6.1.1 Definition An ordered pair (p, g) of distinct positive integers p 
and q is said to be an inversion i{p > q. 

For example, (5, 3) is an inversion but (3, 5) is not. 

6.1.2 Definition Given a permutation P - (Ju ji> •• * Jn) of the set 
{1, 2, ..., n}, we define the set 

{UlJl), UuJi), UuJn), 


The number of inversions in d>p is called the number of inversions in 
the permutation P. 

Example 6.1 Let P be the permutation (3, 4, 1, 5, 2). Then <!*/> = 
{(3, 4), (3, 1). (3. 5). (3. 2), (4, 1). (4, 5), (4, 2). (1, 5), (1, 2), (5, 2)}. Count- 
ing the inversions, we see that the number of inversions in P is 5. 

6.1.3 Definition A permutation (j^ h, 7n) of the set {1, 2 n} is 

said to be an even (odd) permutation if the number of inversions in it 
is even (odd). 

Example 6.2 The permutation (3, 4, 1, 5, 2) in Exampfe 6.1 is an odd per- 
mutation, whereas (3, 1, 4, 5, 2) is an even permutation. 

Now let us take up the definition of a determinant. * To each n x n 
matrix A of numbers we associate a number called the determinant of A in 
the following manner. Let 
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*11 *12 ••• *1*» 

*21 *22 ••• * 2 * 

A = 


1 *nl *«S 

••• ^ttn — 1 

Form all products of the type 


“ly. *2/. 



in that order (the ascending order of row indices). Here (jiJi, jn) is a 
permutation of the set {], 2, n} of column indices. Note that each such 
product contains one (and only one) term from each row and each column 
of the matrix. To each such product assign a ‘plus’ sign or a ‘minus’ sign 
according as the permutation is even or odd. The algebraic 

sum of all these signed products is called the determinant of A. It is de- 
noted by det ./I or \ A \ or 

*11 *12 ••• * 1 » I 

*21 *22 ••• * 2 » 

*nl *n2 ••• *nn 

This last symbol is itself called a determinant of order n. The precise defi- 

nition is as follows. - 

6.1.4 Definition If 



«u 

Oln 



<*21 

022 

••• 02,1 

9 

(1) 

-«nl 

«n2 

••• Onn — 



11 

M 

ir- 

• 

../.)*Vi 

•" *»y«* 

(2) 


where the summation is taken overall possible products of the form 
*1A • .*«/»• ***** *“** 

r + 1 if(yi,./2 y«)i8 

_ J an even permutation 

(.JuJtt I —1 ifiJuJu '••»/») is 

(, an odd permutation. 

The right-hand side of Equation (2) is, called the expataimt of the deter- 
minant of A. 
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Note that there are r! terms in the expansion of det A, because there 
are nl permutations of the set {1, 1, .. , n) of column indices, and to each 
such permutation A) we get a product a ... In fact, 

the permutation (Juh, ■■ ,jn) tells us the order in which the column indi- 
ces are chosen to form the product. 

6.1.5 Remark Det A is defined only when ^4 is a square matrix. If A is 
not a square matrix, det A is not defined. 

Example 6.3 Let 



! 

*13 

*13 

A = 

*81 

a»2 

*23 

1 

[_*n 


1 


Here the six possible products are 

'f^he signs to be attached to these products are 
determined as follows : For example, take The order of the 

columns chosen here is (2, 1, 3). This is an odd permutation. So the 
sign to be attached to this product is ‘minus’ Doing this for every pro- 
duct, we finally get 

M 1 = ana*2a„ 3'n3(2i5'32 4 “u^z'iO'si - 

+ ~ ana2i!«3i • (3) 

Asa numerical example, we may take 
2-1 3 

= 2x4x2 - 2x0x 1+ (-1) X 0 X 
1 4 0 (-1) -(-l)xlxl + 3xlx 1- 

3 X 4 X (-1) = 32. 

-1 1 2 . 

A careful arrangement of the six terms in Equation (3) gives 

= «u(«22«a8 ■ «2J«32) + «is(«28*31 “ «21«33)* 
*31 *88 *23 4* *13(* 21*32 *88*8l) • 

*81 *32 *33 

Clearly, 

*1 *8 

= *1^ — *8^1 and 

Pi Ps 

if .(4 is a 1 X 1 matrix [ai], then det A = ai. 

When it comes to considering determinants of the fourth and ^higher 
orders, the calculation involved in writing out all the terms becomes prohi- 
bitive. So we study further properties of determinants and arrive at 
shorter methods of calculating det A. However, certain special determi- 
nants can be evaliated directly from the definition, for example, 
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0 


0 

X, 


0 

0 


0 

0 


— ^1X2 ... X, . 


0 0 0 ... X, 

In particular, det /» = I and det O^xn = 0. 

Problem Set 6. 1 

1. Determine whether each of the following permutations is even or 
odd : 

(a) (1, 3. 5, 6, 4, 2) (b) (3, 4, 5. 2. 1, 6) . 

(c) (2, 6, 4, 3, 5, 1) (d) (1,4, 3,2,5). 

2. Write down all possible permutations of the set A and separate the 
odd and even ones : 

(a) .4 -{1,2, 3} (b) ^-{1,2, 3, 4}. 

3. Find det A for the given matrix A : 


(a) A - 

-1 

0 

3 0- 

1 2 

(b) A = 

“3 

5 

1 2- 

0 0 


_1 

0 0_ 


_1 

1 o_ 


4. Evaluate the following determinants : 



1 X X* 


1 X yz 


(a) 

1 y y* 

(b) 

1 y zx 

(c). 


1 2 2 ® 

[ 

1 z xyi 

i 


a b c 
cab 
b c a 


5. Prove that the solution of the system 


IS Xi 


Si 

*2 



81 

82 

P2 

■ . Xi = ■ 

Pi 

82 

«! 

«2 


“2 

a 

Pi 

Pi 


Pi 

Pi 


provided that 
6. True or false ? 

(a) If (a, b, c) is an even permutation, then (6, a, c) is odd. 

(b) The sign attached to the product of a third order de- 

terminant is ‘plus*. 



(c) 


(d) 


0 

2 

-5 

0 

2 

-5 
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1 3 

0 

5 
1 

0 
5 


-4 I == 0 

0 
1 


0 


= 0 


(e) The equation 


— 0 has no real root. 


1 — X I 

(f) The determinant of a tiiangular matrix is the product of its 
diagonal entries. 

ri 21 

(g) I 1 -= -2 . 

L3 4_J 

1 ‘1 

(h) I 1 = 0 


-/ 


•1 


6.1 FUNDAMENTAL PROPERTIES 
OF DETERMINANTS 


The fundamental properties of determinants, which follow immedia* 
tely from the definition, are given in this article in the form of theorems. 
Of these, the proofs of Theorems 6.2.1 and 6.2.8 (see § 6.3) are rather com* 
plicated, and a beginner may skip them on his 6rst reading. In this article 
A = (»,/) stands for an n x n matrix. 

6.2.1 Theorem 1/ the matrix B is obtained from A by an elementary row 


For the proof see § 6.3. 
Example 6 4 




1 

2 

3 

4 


1 

2 

3 

4 

-1 

0 

1 

2 


1 

-1 

2 

3 

0 

1 

4 

0 


0 

1 

4 

0 

1 

-1 

2 

3 


-1 

0 

1 

2 


because the determinant on the right-hand side is just the determinant on 
the left-hand side with the second and fourth rows interchanged. 

6.2.2 Theorem If A has two identical rows, then det A = 0. 

^oof : A can be considered as being obtained from itself by inter- 
changmg the two identical rows. So, by Theorem 6.2.1, det A a —det 
llenoe, d^ » 0. | 
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Example 6J 2 3—1 4 

4 I 0-1 

- 0 

12-3! 

4 I 0 -1 

without any further calculation. 

6.2.3 Theorem If A has a row of then det A ~ 0. 

Proof'. deti4=2)e. . .xOf,, « ... a^. . If the A:-th rowis the 

ftn) Vi njn 

zero vector, then is zero for every choice of jk- Therefore, each 
product is zero and this gives det A - 0. | 

Example 6 6 2 1 3 • 

I 

0 0 0 ' 0 

I I k I ol 

without any further calculation. 

6.2.4 Theorem If the k-th row vector oj A is the sum of two vectors bj^ 

and Ck of then \ A \ 1 I ( | C | , where B is the matrix 

obtained from A when r^ is replaced by b^^ and C h the matrix 
obtained from A when r* is replaced by r*. 

Before we take up the proof, we shall illustrate the result by a simple 
example. 

Example 6.7 ql^ ag ag 

Pi P, Pa P4 

bi ■{ Cl Ajs ^ Cg 4- C 3 b^ -h c. 


1 


«! 

«* 

«3 



a* 

*3 

«« 

Pi 


P, 

P4 

Pi 

P 3 

Ps 

P* 

= 



+ 





,*1 

h 

A, 

A* 

Cl 

C 3 

C3 

c« 

i^i 


83 

8« 

81 

83 

8, 

8« 


Proof of Theorem 6.2.4 Let = (ft*„ i**, and <■» = 

Ch f»n)- Then = 6^^4- for every Ac. This shows that each 

product can be written as 
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The algebraic sum of the first type of products with the appropriate 
signs gives det B, and the algebraic sum of the second type of products 
with the appropriate signs gives det C. Hence the result. | 

6.2.5 Theorem 1/ the matrix B is obtained from A by an elementary 
operation of type II (i e. multiplying any row rector by a nonzero 
scalar c), then' det B ~ c det A. 


Example 6.8 


■*1 

Cl 



Cfllj 

cb^ 

cc^ 

~ c 


«3 

K 

Cs 



Proof of Theorem 6.2.5 Let the A:-th row of A be multiplied by c. 

Then the ^-th row of B is (can, ca *2 cn„). So, in the expansion of 

det B each iJroduct is of the form ... (ca. . )...«.. This shows that 

every term of the expansion of det is a multiple of the corresponding 
term by a factor c, in the expansion of det A. Hence, det B — c dtiA. B 
Note that Theorem 6.2.5 holds even if c ~ 0. 


6.2.6 Theorem If the matrix B is obtained from A by an elementary row 
operation of type III {i.e. adding c times the s-th row to the k~th row), 
then det B — det A. 


Example -6. 9 

0^1 ^2 ^3 ' 

1 

a, Og Og 


1 

bi \- cfCi 62 f ar2 *3 ^ 

bi bg bg 


1 

Cl C2 Cg 1 

cx Cg Cg 


Example 6 10 

1 2 3 

4 4 4 


1 2 3 

4 4 4 

_ 

1 2 3 

4 4 4 


5 6 7 


5-1 6-27-3 


4 4 4 


by Theorem 6.2.2. 

Proof of Theorem 6.2.6 Let the .A:*th row of 5 be r* + cr,, where r* 
and r, are the A:-th and J-th rows of A. So, by Theorem 6.2.4, 


det B 


CLii ai2 ... 


*11 *12 ••• 




: : : 


: : 2 



C0t*i C0tj2 ••• CCtgfi 


+ 

• • • 

• • * 

^8l *61 •"* 


*#1 *52 ••• *•»* 


. • ; 

: : : j 

• . 

®fi| ••• *nn • 

*nl *n2 ••• 


s-th row. 
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Applying Theorem 6.2.5, we obtain 

I *11 *1* *1B 

I • • • 

! • • • 

I ' “ 

[ *^2 — *»n 

det B det /4 H f I ; : 1 

I 

} *«2 ••• 


I y 2 • • • I 

~ det A (by Theorem 6.2.2), Q ^ 

6.2.7 Remark Theorems 6.2.1, 6.2.5, and 6.2.6 tell us that the effect of a 
finite number of elementary row operations (of any or all of the three 
types) on det A is to multiply it by a nonzero scalar. 

6.2.8 Theorem det A"^ - det A, 

For the proof sec § 6.3. 

Example 6.11 2 3 4 2 5 3| 

5 7 8 . 3 7 - I , . 

3 -1 2 4 S 21 

6.2.9 Theorem Theorems 6.2 J to 6.2 6 are true if everywhere tie word 
*iow{sy IS changed to *column{sy. 

This is a consequence of Theorem 6.2.8. 

6.2.10 Remark As a consequence of Theorem 6.2.^> the elementary 
operations can be performed as well on the columns of a determi- 
nant, with the same effect as that on rows. 

Example 6,12 Evaluate 

112 3 


Ml- 2 - 

-1 

0 



--1 

0 

1 



1 2 3 


1 

2 

3 

j 

y< 1 = 1 2 -1 0 

= 

0 

-5 

-6 

I 

1-1 0 1 


0 

2 

4 


by r* — 2ri and Using Theorem 6.2.8, we get 

1 0 0 

1 1 2 -5 2 = 1 X (- 5 ) X 4 - I X 2 X (-^ 6 ) == -8 

3 -6 4 

as all other products are 2ero. 
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Problem Set 6.2 

1. If is a square matrix of order n and « a scalar, then prove that 
det {a.A) == a" dct A. 

2. Let ^ be a skew-symmctnc matrix of odd order. Then prove that 
dct A 0. 

3. For a triangular matrix A, prove that det A is the product of its dia- 
gonal entries. 

4. Prove that 


1 

a a® 

1 0 

1 

1 « i p 

1 

P P® 

- (u - P) , 1 

p p' 

1 

6 6® 

u 

S 6® 


0 I « + p 

(« - P) (P - B) (6 - a) 0 0 1 


1 6 6 - 


5. Without expanding, prove that 



1 

1 

3 



h f c 1 

a 

(a) 

2 

9 

1 

= 0 

(b) 

c 4 a 1 

b 


4 

11 

7 



6 -ha 1 

c 


,y b 9 


X y z 


(c) xyz = xap-pqr 


\P 9 r\ 

X y z 

(d) X* f z* 


z c r \ 

nil 


a b c ^ 


x^ V® z® 


' yz zx xy I i x‘ >’® z® 
ahbb + cc + a a b c 

(e) p q q + r r \ p -=2 p q t\ 


x + y y + z z + X 
X x + 3 x-h 6 


X y z 


4 7 10 1 


(f) X -I- 1 x+4 x + 7 =0 (g) ,10 13 161 


x + 2 x+ 5 x + 8 


20 23 26 
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1 a a^ — be 


X —y y — z z — x 

(h) 

1 b b* — ca 

= 0 (i) 

y — z z — X X — y 


1 c c^ — ab\ 


z — X X -- y y — z 


6. True or false ? 

(a) If every row of a determinant of order n ( / 1) is multiplied by 
k and every column by k', then the value of the determinant is 
multiplied by kk'. 

(b) If the diagonal entries of a determinant are multiplied by k, 
then the value of the determinant is multiplied by k. 



a b c 


a b fl f b 

(c) 

la lb 2c 

= 6abc . (d) 

c d c + d 


3a 3b 3c 


e f e + f 



+ a, Pi + Pi h 4 U 


«i Pi h 

Oi Pi U 

(e) 

hi + ba qi + qi m, f w. 

= 

bi qi mi 

+ h qi mt 


Oi + Ca fi + r, Ui f /la 


Cl ri ni 

1 

1 1 Cg ra "t 


a a' a' a a’ a' 

(f) b b’ b' - b b' b' 

' c c' c c c' c 

u 0 0 1 { (/ 0 0 

I I 

(g) b 0 0 =- I € 0 0 

Q d e 1 0 a b 

j ~ 

(h) bj bj b 3 1 = bj — Cl bj “ Cj bj — 

Cl Ct C3 1 Cl — Oi Cj — a* Cj — Of 

6.3 PROOFS OF THEOREMS 

To prove Theorem 6.2.1 we need the following two lemmas. 

6.3.1 LeBuna Let p be the number of inversions in a permutation 
P = (A* A. —.A) of integers 1, 2 , 3, ...» n. Let Q be the permu- 
tation obtained from P by changing two adjacent entries of P. Then 
the number of inversions in Qisp 
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Proof : Let Jt and y»+i be interchanged in P to produce Q 
=* (A* Jit •••» A-v Ati» Jkt Jktf •••» yn)- We have 

= {C/i» A)» iJi> y»)> •••» 0i» y»-i)» (jujt)t (ju y»+i)» •••» (a» y«). 
(A» A)* •*'» (Ji»jlsr-l)t (.Jt} Jld» (At A)-l)i •••t (At7n)i 


(Jk-ujk^> CAt-if A+i)f’* t (/fc-itA)t 

(jhfJki-i)} ••• » 


C/n-lt yn)}* 

The set ^(2 is obtained from <l>p by interchanging and Ai-i. Carefbl 
scrutiny shows that 9q is different from «I>j» in only two ways, namely, 

(i) <hQ does not contain whereas 4>i» contains it, and 

(u) <I»i' does not contain (Jk+iJt), whereas <hc contains it. 

Since cither (y^.y^i) or(yjH.i,y») is an inversion, it follows that when 
we change from P to Q the number of inversions is either increased by 
one or decreased by one. Hence the result. B 

6.3.2 Lemma If the matrix B is obtained from the matrix A *= («,i)«xn 
interchanging two adjacent rows, then det B = —det A. 

Proof: Suppose the At-th and (A: + l)-th rows of A are inter- 
changed to produce B. The typical term in the expansion of det A is, 
keeping the row indices in the natural order, 

*IA “ 2 /, ”* *kik “*-1 i./t+i “A:+ 2 .;h, "• * 

Denoting the entries of B by p,* we have the corresponding typical pro- 
duct m the expansion of det B : 

hjt ^k+l./fc+i *Vi *Vi *^*+1 ■" 

(because the k-th row of B is the {k -J- l).th 
row of A and vice versa) 

“ *1A*2A - “af,* 

By Lemma 6.3.1, we have 
Hence the result. | 

Proof of Theorem 6.2.1 The theorem has just been proved in 
T.femma 6.3.2 for interchanges of two adjacent rows. Now, suppose the 
k-th and x-th rows are interchanged to get B. This transition from A to 
B can be made by carrying out the following operations successively i 

Let a > A; + 1 and let there be t rows between the k-th row and the 
x-th row. Let r, stand for the p-th row, p =» 1,2, .... n. r, can be 
brought to a position immediately above r^, by r + 1 successive inter- 
changes of adjacent rows. After this, r* can be brought to the position 
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originally occupied by r,, by making t successive interchanges of adjacent 
rows. Thus,' the interchange of and r, is equivalent to making (/ + ll 
+ t =s 2t + I successive interchanges of adjacent rows. By Lemma 
6.3.2, the value of the determinant undergoes a change in sign (2t + 1) 
times and therefore changes sign ultimately. Hence, det B = — det A. | 
Proof of Theorem 6.2.8 A and A^ are both square matrices of the 
same order. So the expansion cf det A and det A^ have the same number 
of terms. Each term is a product obtained by taking one (and only one) 
entry from each row and each column in the matrix, and attaching a 
certain sign to it. In view of this, we see that, ignoring these signs 
temporarily, every product that occurs in the expansion of det AT also 
occurs in that of det A and vice versa. In order to complete the proof we 
have therefore to show only that the signs attached to the products also 
coincide, irrespective of whether they are obtained in the expansion of 
det A^ or in that of det A. We shall prove this in the following manner : 


Let A — (^ij)nxft. Then A"^ — • (^i>)nx«5 where — oi,,. 
term in det is 

/ t 

Uuht •• Jn) ‘ "Ai > 

Taking product (1), without the sign, we have 


A typical 

( 1 ) 




= a, , a. , a . , 

I\ ^ jfi n 

Here {juht is a permutation of the set (I, 2, ..., n). Hence, 

= 1 for some ki G {1,2, ..., n) 
y*, — 2 for some fcj G {1,2, ..., n}, where kj / ki. 


( 2 ) 


y^. = n fv)r some G {1, 2, .. , n), where k„ 4 k„. i, .. , k,. 

So product (2), without the sign factor, is 


i.e. 


*1A, “2A, 




(3) 

Product (3) is the form of the product as it occurs in det A. The sign 
attached to product (3) in det A is ^(ki,kf, ...,*«)• attached 


to product (2) in det A^ is, from product (1), ‘(y^.y^, 

If we can prove that these two signs are the same, we would be 
through. These signs depend on the number of inversions in the permu- 
tations P = iJuJt, and Q — {ki, k k„). So we shall now 

analyse the process by which we obtained the rearrangement (3) from (2). 

Both (2) and (3) represent the same product. The entries in product 
(2) have the column indices in the natural order 1, 2, ..., n, whereas the 
entries in product (3) have the row indices in the natural order. The 
order of rows in product (2) is P and the order of colunuis in product (3) 
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is Q. The passage from product (2) to product (3) is nothing but the 
rearrangement of P in the natural order. It is presented schematically in 
Table 6.1. 

Table 6.1 


Order of rows Order of columns ^ 

P ^ iJuJt, -.jn) (1,2, ...n) 

~ tjn) (I, 2, ..., ki, ..., n) 

I / interchanges j. 

•••• hi-i, " l>^i + 1> . ..n) 

* • - » Jn) 

( Jit " tjn) U^lt 2, ..., ATj, . , w) 


V 

^ ^ki A,’ ••• 

I 

_ i 

^ 4 ,’ 4 ,* •• ’ hj 
= (1, 2, .... «) 


s interchanges !■ 

y») (^1* i» 2, , w) 

f 

i 

{kif Ar„) 

-e 


The first line in Table 6.1 indicates the order of rows (--P) and the 
order of columns (natural order) in product (2). The last line indicates 
the order of rows (natural order) and the order of columns (=0) in 
product (3). 

The passage from product (2) to product (3) presented in Table 6.1 can 
be realised by successive interchanges of adjacent entries in the respective 
permutations. Since P — UitJtt ..../»)» look for/^, — • and bring it to 
the first position by interchanging it successively with all the entries 
preceding it. This needs a certain number of interchanges, say t. The 
effect of these interchanges is to reduce the number of inversions in P by t. 
If we make the sams kind and number of interchanges in the order of 
columns, namely, the natural order 1, 2, 3, ..., n, we get (k^, 1, 2, ..., 
kx — \,ki 1, ...» n), the effect of which is to increase the nuihber of 
inversions in (1,2 n) by r. 

Now we look for = 2 and bring it to the second position by 
making successive interchanges. Suppose this requires s interchanges. 
The same s interchanges carri.id out on the order of columns will bring 
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to the second position. The effect of this is to reduce the number of 
inversions in the order of rows by s and increase the number of inversions 
in the order of columns by s. 

Carrying on this process, we arrive at .... i.e. the natu- 
ral order on the left and at Q = (fci, kn) on the right. Thus, the 

number of interchanges required to bring P to the natural order is the 
same as the number of interchanges required to bring (1, 2, ..., n) to 
(^ 1 , ^n) = Q‘ Since the number of inversions in (1, 2, ..., n) is 

Eero, it follows that the number of inversions in P is the same as the num- 
ber of inversions in Q. Hence, —, 7 ,) “ k, Jfc,) 

proof is over. | 

6.4 COFACTORS 


The expansion of an n-th order determinant is the sum of all the n! 
terms, each of which is a product obtained by taking one (and only one) 
element from each row and each column. Let A = Suppose we 

collect all the terms in the expansion of det A, in which the fixed element 
appears as a factor, and write down their sum in the factored form 
utfA^. Here An denotes the factor remaining when the element is fac- 
tored out. We call A„ the cofactor of an in det A. 


Example 6.13 


«u *« *1* 
*81 *88 *88 
*31 *88 *88 


*u(*88*88 ~ *88*88) 

+ * 18 (* 88*81 ~ * 81 * 88 ) 
* 1 * * 18 (® 81*88 — * 8 *® 8 l ) • 


So All — cofactor of xu — as 2 « 3 s -* *88*88 

All *= cofactor of ai, = aija,! — 

All — cofactor of ai, = o(ti*sa “ *88«8i • 

If we want any other cofactor, say An, we have to rearrange the above 
expansion and collect the terms containing a,,. Thus, we see that An 
“ * 18*81 — * 11 * 88 * 

An explicit formula for the cofactor of «n is given by Theorem 6.4.2. 
For this we need the following definition. 

.6.4.1 Definition The determinant obtained by deleting the f-th row and 
the/-th column in det A is denoted by A^. 

En is also called the minor of the element xn in det A, but we shall 
not use this terminology. 

1*11 *11 “ill 


Example 6M For the determinant 


*81 *88 *88 1 t 


*81 *88 *tt 
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All 

and so on. 

Example 6,15 l{ A 



9 

A„ = 

*11 *1* 


ttjs 1 


*11 *11 


(<*«)nXn» then 
otia 


Ann — 


*81 




n-1 
a2* n-1 

*n-l» n-1 


*n-l> 1 Otn-i» s 

6.4.2 Theorem Let A = (a<^)nxn* Then for each i = 1, 2, n and 

y=l,2, 

(1) 

Proo/ ; First, we shall prove a special case of the theorem, namely, 
that Ann* To prove this we collect all the terms involving a„.. 

They are of the form 

( Jn-it w) “lA*2yi *** * 

where (y\,y, Jn i) is a permutation of the set {1, 2, ..., (n - 1)}, The 

sum of all these terms is But 

(,Ji» ht "•» y»_i> w) ®(_/j, , 

since the integer n occurring last does not increase or decrease the number 
of inversions in ( j\, Therefore, 


«11 

*11 

••• *X» W-l 

a*! 

*» 

••• *39 n-1 

• 

• 

• 

• 

• 

• 

• 

• 

9 

*»i-i> 1 

*fi-i» 1 

••• *n-l9 n- 


(by definition of a 
determinant) 


Now we take up the general case and reduce it to the special case. We 
have 



P : 

C i 

R 

det it 

S j 

*</ : 

T 


u j 

y :* 

W 


where P, Q, R, S, T, U, V, and IF are mere abbreviations* for the remaining 
entries. V, V, and W have (« — 0 rows; R, T, and W have (ft —j) 
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columns; S and T have only one row, and Q, V have only one column. 
Clearly, 

\P Jti 


A« = 


( 2 ) 


U W\ 

Shifting the I'th row by successive interchanges with the (n — /) rows of 
V, V, and fV, we get 

\P Q R 


det A = (-1)"-* 


U V W 


(by Theorem 6.2.1). 


1 5 a„ r 

Again, by another scries of interchanges of the jf-lh column with (« — J) 
columns of R, IV, and J and by applying Theorems 6.2.1 and 6.2.9, 
we get 

PRQ 


V W V 
6 T a.. 


det A = (— !)"-• (-!)» » 

So the cofactor of a„ in det A 

= (— i)»+i X cofactor of a,^ in 
P R 


'PR Q 
V W V 
S T 


V wl 

by the preceding part of the proof. Hence, = (—!)*+< by 
Equation (2). | ' 

Example 6.16 Consider 

a h g 
h b f\. 
g f c\ 

The cofactor of h occurring in the second row, first column, is 
b g 


(_I)m 


1 / c 
irri 


= -(Ac - gf) ^‘fg - ch . 


The cofactor of/ occurring in the third row, second column, is 

a g 

h f 
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Since this determinant is symmetric, the cofactors of elements, 
which are symmetrically placed with respect to the diagonal, are the same. 
So, for example, we need not distinguish between h and an h. 
Both hive the same cofactor. (Check!) Denoting the cofactors by 
capital letters, we have 

A — be — f*, B = ca — g*, C = ab — h*, 

F=-gh-af, G = hf~bg, H=^fg-ch. 

The n! terms that occur in the expansion of det A can be separated 
into n groups as follows : ^ 

(1) all terms containing 

(2) all terms containing a ,2 

(n) all terms containing . 

Each of these groups contains (« — 1)! terms, since this is the 
number of terms in any A,,, which is a determinant of order (n — I). 
These group, arc mutually exclusiie, because when a term contains a, „ 
It cannot contam any other element from the first row. Thus, there ate 
n mutually exclusive gioups, each containing (n — 1)! terms. Therefore, 
the total number 'of terms m all these groups s n X (n- 1)! == nl. 
Hence, it follows that all the terms in the expansion of det A are exhaust* 
ed by this grouping. Thus, we have 

det A = + a,ji4„ + ... + • (3) 

If, instead of the first row, we focus our attention on the elements of 
the i-th row and collect terms involving a,i, a,*, •• , etc , we get, by the 
same argument t s that which resulted in Equation (3) : 

det A — a,|i4,^ -j- <Xf%An ... <XtnAfn . (4) 

Similarl>, we can work with the elements of any column, say the^-th 
column, to get 

det A = oijA-ii + o^tfA^ + ... + cc„fA„f . (5) 

Thus, we have proved the following theorem. 

6.4.3 Theorem If A — (a,i) is a square matrix of order n and An denotes 
the cofactor of in det A, then,fbr each i = 1,2, ..., n 


ft 


det ^ = 2 

cttkA.it 

(6) 



and, for eachj =1,2, ..., n. 



det A ^ 2 
k~l 

»t,At, . 

(7) 


Equation (6) is called the expansion of det A in terms of the i-th 
row and Equation (7) is called the expansion of det A in terms of the J-th 
column. 
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Exan^le 6.17 Evaluate 

a h g 
h b f 
g f c 

Expansion in terms of the first row gives 

6. => aA hH + gG . 

Expansion in terms of the second row gives 

. ts^hH + bB+fF, 
and expansion in terms of the third column gives 

gG +fF+ cC . 

Taking any one of these, we get 
ii = aA+hH + gG 

= a(bc -P) + h{/g - ch) + g(fh - bg) 

= abc + 2fgh — ap — — cA* . 

In order to evaluate a determinant, we usually use the theorems of 
§ 6.2 to introduce as many zeros as possible in any row (column) and then 
expand in terms of that row (column). 

Example 6.18 Evaluate 

2 1-3 4 

I 0-12 
3-2 10 

-14 2 1 

Multiplying the first row by 2 and adding it to the third ruw, we get 
21-34 21-34 

10-12 10-12 

A = = 

7 0 -5 8 r4-4ri 7 0-5 8 

-14 2 1 _9 0 14 -15 

Expanding A in terms of the second column, we get 

"1-12 10 0 

A=.7-5 8 = -72-6 

c>+ «!. 

-9 14 -15 c, - 2Cj, -9 5 3 

where c, denotes the /-th column. Now expansion in terms of the first 
row gives 

2 -6 

A = - « _ (6 + 30) - -36 . 

5 3 
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6.4.4 Theorm Let the row vectors of the siptare matrix A » («<^)ax« ho 
fit fi* “‘t '’«• Let the vector Rt denote the vector of cofactors, in 
det A, of the element of r<. In other words, 

= (*<1* «<li > «M» ..•» «<•) 

and R-i * (At,, Afg, ,,,, A,f, ...^ • 

Then rt - Rt det A for ail i = 1, 2, . ,n, 

and r, ' Rf a ifi^j. 

In short, rt • R/ = 8,^ det A for all i, / = 1, 2, , n. 

Proof : The first result is only a restatement of Equation (6). To 
prove the second result, let us construct a matrix B by replacing the J-th 
row of A by the l-th row of A. Note that the Hh row of A remains as it 
is in this construction. So 

*11 «W ■ . *ln 

««i *«* ••• ®«n **th row 

deti?= : : i 

a.i »(s .. «<n ->-y-throw 


I a„i (Xfi2 . . oCfjfi I 

This determinant is zero, because two rows are identical. On the other 
hand, we can expand det B in terms of its y-th row. Since the deletion of 
the J~th row and the A:>th column of det B gives the same A/t as the 
deletion of the y-th row and the fc-th column of det A, we get 
0 = det B = + ... + ^inA/n 

= * Rj. I 

6.4.5 Remark A similar result as in Theorem 6.4.4 is true for columns. 

6.4.6 Corollary Let A be the matrix (a,>)„x» «nd B the matrix lP«)iix»# 
where p,^ = Af,. Then 

“A 0 0 ... on 

0 A 0 ... C 

AB::- BA = = A/, , 

_0 0 0 ... A _ 

where A = det A. Consequently, det {AB) = A” » det (BA). 

The proof is obvious when we carry out the multiplication of A and 
B and repeatedly use Theorem 6.4.4. 
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6.4.7 Oefiaition The matrix B cf Corollary 6.4.6 is called the adjoint of 
A and is written as adj A. 

Example 6.19 Find the adjoint of 


A = 


n - 

1 on 

0 

‘ ' i 

_i 

2 IJ 


The cofactors of the different entries in del A are 


Therefore, 


la = 

-1, 


1. 

-^13 ~ 

-I. 


1. 


1. 


-3. 

^81 ■= 

-1. 

^32 = 

-1. 

-^33 ~ 

1. 



r-i 

1 

-n 

1 

I 



adj A — 

\ 

\ 1 

1 

-1 

• 



) 

L-1 

-3 

ij 




The adjoint is of significance in finding the inverse of a nonsingular 
matrix, as will be shown at the end of § 6.5. 

Problem Set 6.4 

1. In Corollary 6.4.6 we repeatedly use Theorem 6 4.4. How many 
times do we use it ? 

2. Prove Remark 6 4.5. 

3. Evaluate the following determinants : 



2 1 0 


1 2 4 

(a) 

1 0 3 

0 3 2 

(b) 

2 3 1 

3 4 2 


(c) 


1 3 4 

1 6 10 
I 10 20 




1 I 1 1 I 

3 2 14 

1 3 8 7 6 



1 

1 


1 2 3 4 5 

1 15 29 2 14 


7 4 10 2 



i 

(e) 


(f) 

1 3 6 10 15 

' 16 19 3 17 


6 8 5 8 



1 




1 4 10 20 35 

1 33 39 8 38 


9 5 3 9 




1 

1 5 15 35 69 


(di 


4. Without expanding, prove that 


1 


y + z 


1 

1 

1 

1 

zx 

Z + X 


X 

y 

Z 

1 

xy 

X + p 


X* 

y* 

2* 
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5. Prove that 

I X JC* 

(a) 1 y y* — {x — y){y - - jc) 

I z z® 

1 X }Z 

(b) I y zx ix - v)(y - z) (z - y) 

1 z xy 

X T o b e d 

t 

a X b c d 

(c) = Y*(x 4 a4-*4-c4-</). 

a b Y 4 c d 

a b c X -{■ d 


6 


If wj, (02, and <0, are the three cube roots of unity, then prove that 

Xi Xt Yj 

3 

r* jfi Xi =■ II (Xi f x*6), 4 YjfeiJ) 

I 1 

Xi Xa \i 

This determinant is called a circulaiU ot the third order Write 
down a circulant of order n Write also its value 


(a) 


Prove that the equation of a ciicle throuph three points (jci, >2), 
ixt, 1 2). and (Yj, >3) IS given by 

x^ i-y' X y 1 I 

fj'i 3^1 • 

1 

AS|4-J'i Xi >'* 1 

y| 4- yl Xa ya 1 


(b) Determine the equation of the sphere passing through the points 
(yj, } i, Zi), (^2, yi, Zi)t (xat yat Xf), and (y^, ^4, Z4) in the deter"* 
minant form 


8 Solve the equation 

X a b c 

C Y 4 - * « 

a b Y + c 
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9. 


Without expanding; prove that 
1+0 1 1 1 

1 1 +* 1 1 

I 1 1 + e 1 

I 1 1 1 + (/ 


= «»««•+ 3 + S + -i + 5). 


10. Calculate the adjoint of matrices of Problem 2, Problem Set 5.S. 

11. True or false ? 

r cos 0 —sin 6 “) 

(a) In the matrix | | the cofactor is —sin 6 . 

L sin 0 »cos 6 _J 

(b) There exist determinants none of whose entries is zero, but for 
which every cofactor is zero. 

(c) If a matrix is nonzero, then its adjoint is also nonzero. 

(d) adj (adj A) = A. 

(e) adj (a/,) = 

(f) If adj Ais i diagonal matrix, then A is also diagonal. 


6.5 DETERMINANT MINORS AND RANK 
OF A MATRIX 


Given a matrix A, we can get many smaller matrices from it by simply 
deleting a certain number of its rows and/or columns. Matrices thus ob- 
tained are called submatrices of A. 


6.5.1 Definition The determinant of a square submatrix S of is called 
a determinant minor of A or simply a minor of A. 


Example 6.20 Let 


n 2 

Thenfi= | 

L9 10 

A and also of B. 


A 


” 1234 - 
5 6 7 8 

_9 10 11 I2_ 


3n 

iij 


is a submatrix of A and 


I 1 
9 


3 

11 


is a minor of 


6.5.2 Lemma (a) Let A be an m x n matrix. Apply somi elementary row 
operations to obtain a new matrix Ai. Delete some colurrws of Ai to 
get a submatrix By of Ai. The same submatrix B^ could also have 
been obtained if we had first deleted the same columns from A itself 
to obtain a submatrix B and then applied the same elementary row ope* 
rations to B. 
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(b) If Bt is a square matrix (and therefore B also), then det B is eq^i 
to some nonzero scalar multiple of det Bi‘. 

The proof is obvious, because of the way elementary row operations 
work. Deletion of a column or columns will not affect the result of the 
elementary row operations on the remaining submatrix. 

Part (b) is qnly a restatement of Remark 6.2,7. 

6.5 3 Theorem If A is an m x n matrix, then the rows of A are Ci iff A has 
a nonzero minor of order m. 

Proof : Let A^ be the row-reduced echelon form of A. Suppose the 
rows of A are Li. Then Ai would contain m nonzero rows. The m 
columns containing the Ts at the steps will also be nonzero. Delete the 
remaining columns of Ai and obtain mm x m submatrix Si of Ai. Ob- 
viously, Bi = /« and det Bi = det = 1. By Lemma 6.S.2 (b), the cor- 
responding square submatrix B of the matrix A will have the property that 
det B is a nonzero scalar multiple of det Bi, which is 1. So det B # 0. 
Thus, A has a nonzero minor of order m. 

Conversely, suppose A has a nonzero minor of order m. Let B be the 
corresponding submatrix. We shall now prove that Ai contains m nonzero 
rows. Suppose, if possible, Ai has a zero row. The same operations 
that reduced A to Ai will reduce the submatrix B to B^. Since B^ is of 
order m x m and at least one of the m rows of Ai is zero, it follows that one 
of the rows of Bi is zero. So det Bi == 0. But, by Lemma 6.5.2 (b), det B 
is equal to some nonzero scalar multiple of det Bi, which is zero. This is 
a contradiction. Thus, all the rows of Ai are nonzero. In other words, 
the rows of A are li. | 

6.5.4 Theorem The rank rofanmxn matrix A is the order of the largest 
nonzero minor of A. 

In other words, the matrix A is of rank r iff there exists a minor of 
order r which is nonzero, and every minor of order s > r is zero. 

Proof : Let p be the integer such that there exists « minor of order 
p, which is nonzero, and every larger minor is zero. We shall flow prove 
that r = p. 

A has rank r, r tpvs of A are u. Choose such r rows. Let B be 
the submatrix of A obtained by deleting the remaining rows, B is an r x n 
matrix, all of whose rows are li. Therefore, by Theorem 6.5.3, B contains 
a nonzero minor of order r. Hence, r < p. ^ 

On the other hand, look at the nonzero minor of order p. This gives 
rise to a p X p submatrix B. This in turn gives rise to a p X n submatrix 
CtitA. C contains a p X p nonzero minor. Hence, by Theorem 6.5.3, the 
rows of C are u. This means that A contains p u rows and sop < r. 
Thus, r » p. I 
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6.5.5 Corollary A square matrix A of order n is nonsingular iff det A ^ 0, 
The proof is left to the reader. 

“3 -1 2“ 

Example6.21 Find the rank of 0 1 —3 by examining the 

_6 -1 1 _ 

determinaht minors. 

3-12 ,3-12 

l/ll - 0 1-3 - 0 1 -3 =- 0. 

/•, - 2ri 

6-11 01-3 

1 -3 

So the rank of A is less than 3. The minor ^ 0. 

-1 1 

So the rank of A is 2. 

INVERSE OF A MATRIX 

We arc now ready to give another method of finding the inverse of a 
nonsingular matrix : 

Let A — be a nonsingular matrix. By Corollary 6.4.6, we 

have 

AB = BA = M , 

where B — adj A and A = det A. Since A 0, we get 


1 .. . 



= 1 adj A 


^11 ••• ^nl "1 

/ 

1 

dil2 4^22 ••• d4n2 

det A 

m • 

• • • 

• « • 


^In ^2n ••• ^i»n— . 


Example 6 22 Find the inverse of the matrix of Example 6.19. 
We have 



n 

-1 

on 

--1 

1 

-1" 

A » 

0 

1 

1 and adj A 

1 

1 

-1 


_1 

2 

IJ 

U -1 

i -3 

1„ 


JJ?re det A = —2. Therefore, 
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- 1/2 - 1/2 1 / 2-1 

/ 4-1 = - 1/2 - 1/2 1/2 I . 

L 1/2 '3/2 -1/2J 

Problem Set 6.5 

1. Give explicitly the proofs of the ‘if’ part and the ‘only if’ part of 
Theorem 6.5.4. 

2. Use determinant minors to calculate the rank of the matrices of Pro- 
blem 1, Problem Set 5.5. 

3. Using determinants, prove that the matrices of Problem 2, Problem 
Set 5.5, are nonsingulaf. 

4. Use Theorem 6.5.3 to solve Problems 1 and 2, Problem Set 3.5. 

5. Calculate the inverse by adjoint method for nonsingular matrices of 
Problem 2, Problem Set 5.5. 

6. True or false ’ 

(a) If k-th order minors of a matrix A are all zero, then the rank 
of /t is k — 1. 

(b) If the rank of A is k, then every It-th order minor is nonzero. 

ri 2 31 

1 2 

(c) In the matrix A = 12 4 the minor is zero. 

1 2 

1_0 0 OJ 

Therefore, the rank of i4 is 1 . 

(d) If a row and a column of an n x n matrix A are zero, then the 
rank of A is less than or equal to n — 2. 

6.6 PRODUCT OF DETERMINANTS 

In this article we shall study the determinant of the product of two 
square matrices In this connection we have the following theorem. 

6.6.1 Theorem If A and B are two square matrices of the same order, then 
det (AB) » (det A) {det B) . 

The proof of this theorem is rather complicated. So we shall be satis- 
fied with verifying the theorem for 2 x 2 matrices. 

r" «ii «u— I |— Pii p«-j 

I.et A s I and H » t | • 

— *st-l LPsi Ps*J 
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Then det A =» «u«m — «ii«n 

and det B = PuPm ” PnP*i- 

We shall now calculate det {AB). Since 

n «1 iPh + «U^l *lA« + “mPm”) 

AB^\ I . 

I— «iiPii + ^tPn *iiPm + ***P»*— I 

we have det {AB) = (auPn + auPai)(«iiPii + ®mP»*) 

“ (“iiPii + *mPm)(*»iP« + ®*lPll) • 

A merciless simplification will show that det (AB) = (det A) (det B). 

Though we have not proved Theorem 6 6.1, we shall be using it in the 
sequeL A complete proof can be found in advanced texts on the subject. 

6.6.2 Corollary If A is a nonsingular matrix, then 

det{A-^)=^{detA)-^ Wt ' 

Proof : We have AA~^ = /. 

So det (AA-^) = det / = 1 

or (det A) (det A~^) = 1 . 

Therefore, det 0 and the result follows. | 

Theorem 6.6.1 can be rewritten in the following form. 

6.6.3 Theorem (Reworded) If A (««) and B = (Py) are square matri- 
ces of order n, then (det A) (det B) = det C, where C = (Ci/)„xn and 

n 

Cy = 2 «rtPlM. 

Examine 6.23 Let 


A = 


-r 

4 


and B = 


-1 

3 



L.1 2 IJ 

L 1 

Then det A « 

1 0 -1 

2 3 4 


1 0 -1 

0 3 6 


1 2 1 

1 1 

0 2 2 


on 

1 

3 


- 6 . 


and det B 


-12 0 
3 6 1 
1 $ 3 



-13 0 


12 1 

ass 

0 12 1 

«(_|) 


rn + 3rt, 

^1+ rt 

0 7 3 

7 3 



=-29. 
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r-2 -3 -3“ 

AlsoiiSs 11 42 15 and 

L 6 19 5J 

-2 -3 -3 1-2 -3 -31 -2 -3 -3 

dct(>4i»)=^ 11 42 15 = 11 42 15 = 1 27 0 

fs + 3ri r, + 5ri 

6 19 S 0 10 -4 0 10 -4 

0 51 -3 

51 -3 I 

= 1 27 0 = - =* - (-204 + 30) = 174 

fi + 2r, 1 10 —4 

0 10 -4 

= (det .4) (det B) . 

Problem Set 6.6 

1. In the proof of G>rollary 6.6.2 justify the step ‘Therefoie 

det A # O’. 

2. V A and B are square matrices of order n, then prove that 

det (A^B) = det (AB^) = det (AW = det {AB) . 

3. If d is a square matrix, then prove that det (d") =» (det d)" for all 
positive integers n. (Hint : Use induction.) 

4. Prove that the determinant of an idempotent matrix is either 0 or 1. 

5. Evaluate det d, if d is a nilpotent matrix. 

6. Prove that 

lea** 3 a+h+co* + h* + e* 

(a) 1 6 i* = a + 6 + c a* + c* a* + 6* + c* 

1 c c» a* + h* + c« a* + h» + c» a* + 6* + c* 

0 z y * y* + z* xy xz , 

(b) r 0 * = xy z* + *• yz 

y X 0 zx yz 3^ + y* 



2yz — X* z* 


X y z 

(0 

z* 2zx — y* X* 

- 

y z X 


y* X* 2xy — z* 


z X y 
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7. Prove that 


an 

ai2 

-V 

ai3 1 

1 

^11 

Ai 2 

Aig 

aai 

a22 

« 

II 

^21 

A22 

^23 

aai 

aaa 

1 

aaa ' 

^21 

A22 

A23 


where is the cofactor of 
8. True or false ? 

(a) If A is involutory, then det ^ = I. 

(b) If (del A) (det J?) = I, then AB = /. 

(c) det (i4 -h = det A + det B, 

(d) (det (cA)) (det (B)) -- c(dct A) (det B), where c is a scalar. 

(e) det (AB) = det (BA). 

(f) det G SFr (Win, n)* 

(g) If A and B are two square matrices such that A = BC for 
some invertible matrix C, then det A ~ det B. 

6.7 APPLICATIONS TO LINEAR EQUATIONS 


Recall Theorem 5.8.2. The system of n equations in n unknowns 

aii-'Vi + aiaXg + ... + ccmXn = Pi 

H “I” •" *4" ^ZnXft “ PjJ ^1^ 

^nl^l 4“ ®^n2'^2 4^ ••• 4" ^nn^n ~ Pn 

h.s a un’que solution iff the mitrix A == (a„)„x» is nonsingular, i.e. 

det 0 (cf Coiollary 6.5.5). We shall now give a method, using 
determinants, of finding the solution when det A 0, 

Let thccofaclor of a,-^ in det A be Aij. Multiply the first equation of 
system (1) by An, the second by A^, and so on, the last equation by A^u 
and add. We get 


4” ^21^21 4- ••• 4' O^nlAni) 
4" 4“ ^22^21 4“ ... 4" CCn^Ani) 

+ 


4* 4“ 4" ••• 4" fXrtin^nl) 

= Pl^ll 4- P2-^21 4- — 4” Pn^nl • 


In view of Theorem 6.4.4 and Remark 6.4.5,' this equation becomes 


jCi det A 


4" + ••• 4- Pn^ni 

Pi ais ... am 


Pt *as 


Pn ®iiS 
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The last equality can be seen by expanding this new determinant in terms 
of its first column ; 

Pi *12 *13 ••• *1» 


So 


Xi = 


1 

det A 


Pi *23 *23 ®2» 


P» *n2 *nl ••• **i 

In the same manner, if we multiply the first equ ition by Ad, the 
second by and so on, the last by and add, we get 


( 2 ) 



ail 

Gri2 

*1, ,-i Pi 

ai, .. 

. am 

1 

an 

a22 •*- 

*2, i-1 P 2 

a>2f jn •• 

. aon 

** " det A 


: 

; : 


J 

\f2.f •••! It, 

am 

an2 

■ a^, j—x Pt» 

an» j+l • 

.. (Xfin 


This method of solving a system of n equations in n unknowns is 
known as Cramer’s Me. This can also be derived as follows : 

System (1) can be written in matrix notation as 

Ax ^ b , 

where A is the square matrix (««)»xn, x = (xi, Xjj, ..., x„y, 
b = (Pi, p3, •••, P«)^- Since A is nonsingular, we get 

A-\Ax) = A-^b 


( 3 ) 


or 

But 

Hence, 


X = A~^b 


'*■' = asni 




(cf§6.4). 


( 4 ) 


( 5 ) 


or 


rxi . 


r* All A 21 ••• ^nl 


Xt 


4^12 ^22 ^n2 


■pi“ 

• 

• 

• 

1 

• • * 

• • * 


P. 

Xt 

det A 

Aif A%i ••• Anf 


• 

• 

• 


\ 5 5 

LP.J 

'm.X»J 

1 

A%n ••• 



Therabr^ 

“ det ”* ^ 
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*11 *1* ••• Pi ••• *1» 

J *11 *11 Pi *ln 
“ det ii ; : : 

*nl *»l ••• Pn ••• *n)» 

t 

y-th column 

Example 6.24 Solve, by Cramer’s rule, 

2jc - 3y + z = 1 

X + y — z — 0 

X — 2y + z = — 1 . 

-2 -3 n 

Here \ 1-1 

_1 -2 Ij 

and det = 1 . Therefore, 



1 

-3 

1 


2 

1 

1 

-1 

0 

1 

-1 


1 

0 

-1 


-1 

-2 

1 


1 

-1 

1 


2 -3 1 


and z = -j- 1 1 0 == -4 . 

1 -1 -1 

Note that if det ^4 = 0, then A has a rank less than n and so » 0 
has nontrivial solutions. In this case Ax = b may or may not have a solu- 
tion. Even if it has a solution the solution will not be unique. Converse- 
ly, if Ax = 0 has nontrivial solutions, then rank A is less than n. So 
det i4 =s 0. Thus, we have proved the following theorem. 

6.7.1 Theorem ^41 = (a</)«xn> tAen Ax = 0 has nontrivial solutions^ 
det A =a0. 

6.7.2 Remark When det i4 — 0, Cramer's rule cannot be used. (Why?) 

Problem Set 6.7 

1. Use Cramer's rule (if applicable) to find the solutions of the following 
systems of linear equations : 

(a) 3x + y « 1 (b) 2x - 3y = 7 (c) x + 2y -f 3* « 3 

5x + 2y*»3 x + 4yal 2x — z — 4 

4x + 2y + 2z as S 
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(d) X — y + 2z = I (e) x + y + = 3 

2x + 2z = 3 2x + 2 j» + 2 z = 7 

3x + > + 3z = 7 3x + 4;^ + 3z = 2 . 

2. Repeat Problem 1 for the systems of linear equations of Problem 1, 
Problem Set 5.8. 

3. Find the inverse of the coefficient matrix for the systems of linear 
equations of Problem 1 by any method, and use Equation (4) to solve 
these systems. 

4. If the coordinate axes in a plane are rotated through an angle a, then 
the old coordinates (x, y) are expressed in terms of the new coordi- 
nates (x', y') as 

X = x' cos a — / sin a 
y = x' sin a + y' cos oc . 

Use Cramer’s rule to express (x', y') in terms of (x, y). 

6.8 EIGENVALUES, EIGENVECTORS 


An n X R real matrix has been considered as a linear transformation 
from Ffl to K„. The simplest type of linear transformation is the one that 
merely multiplies all vectors x in by a fixed scalar, that is.'.^x => Xx for 
some fixed X Now we shall discuss those situations where the effect of a 
linear transformation is simply scalar multiplication, at least in part of the 
domain space. In the process we shall see that determinants come in very 
handy. In this article we shall deal with complex vector spaces and com- 
plex scalars. Consequently, the matrices may have complex entries also. 

First, we shall take up a 3 X 3 matrix : 

*11 *1* *i»'l 

A = a*! Xii *(3 

_*8i *S* *88— 

Our aim is to find out whether for some nonzero vectors x = (x^, X 3 , x,)^, 
it is possible to have 

i4x = Xx (1) 

for some suitable scalar X. From Equation (1) we have 

i4x — Xx = 0 , 


or 

Ax - X(/x) = (.4 - X/)x *= 0 . (2) 



«u — > 

aia aia 

r*r 

i.e. 

*11 


X, 


1 

L *81 

«81 «88 - ^ J 

Lx,_ 
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Such an equation has nontrivial solutions, by Theorem 6.7.1, iff 

, aji X ajg ax3 

I 

«2i ^ira ^ *23 == 0 . (3) 

I ocai <X32 0C33 X 

Expanding this determinant, we find that Equation (3) reduces to an 
algebraic equation of the third degree in X. Since our scalars are complex 
numbers, we are assured of three roots for this equation. Let us call these 
roots Xj, Xg, and X3. For each of these X’s, it follows that Equation (I) has 
a nontrivial solution. Denote the set of these nontrivial solutions of Equa- 
tion (1) for a given X by E(\), 

The values X^, Xo, and X3 of X are called eigenvalues of the matiix and 
each vector belonging to L'(X) is called an eigenvector corresponding to the 
eigenvalue X. 

Corresponding to each X,* i ~ 1, 2, 3, we have a set of eigenvectors, 
denoted by ^(XO, / == I, 2, 3. 

The precise definition is as follows. 

6 8.1 Definition If ^4 is a square matrix of order n, then the values of X 
for which the equation 

Ax -- Xa: (4) 

has nontrivial solutions are called the eigenvalues oi A, If X is an 
eigenvalue, then the nonzcio vectors x, for which Equation (4) holds, 
are called eigenvectors corresponding to the eigenvalue X. 

Eigenvalues arc also called ‘characteristic values’ or ‘proper values’. 
Similarly, the terms ‘characteristic vectors’ and ‘proper vectors’ are also 
used. 

By Theorem 6.7.1, it follows that eigenvalues X are simply the roots of 
the algebraic equation 

det (A - X/j = 0 . (5) 

Equation (5) is called the characteristic equation of the matrix A. 
det {A — X/) is a polynomial in X and is called the characteristic polynomial 
of the matrix A. Note that this polynomial has degree w. Hence, there 
can be at most n distinct eigenvalues. 

Example 6.25 Let 

""1 -1 2n 

i4 = 0 10 

-I 2 1 

To find the eigenvalues of id, we solve 




1 - X -1 
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2 I 


0 1 - X 0 = 0 . 

I 

1 2 1 - X ! 

This gives 

(1 - X)((l - X)* -I (-2)) - 0 
or (1 - X)(X2 - 2X - - 1) - 0 . 

i.e. X = 1, 1 + \/2, 1 - v2. 


So the eigenvalues of A are 

Xj - 1, Xjj -= 1 -1 V2, Xa =■ 1 - V2- 

To find £(Xi) = £(i), we write 


ri -i 21 


r'.vxH 


1 

r 1 0 on 

’~Xx 

0 1 0 



- 1 

.V, 1 1 

1 

0 1 0 


Xi 

_1 2 1_ 


L:>r3 J 

1 

1 

L.VaJ 

LO 0 1. 




ro -1 2 -' r.Y,-| ron 

I I I 

i.e. O' 0 0 I i I - ' 0 

! ' ! I 

l_l 2 OJ l_Xj J 1.0 1 

or - .Xj + 2 x 3 = 0, .\t -I 2xt ~ 0. 

This gives Xi =- 2^^ and - 2 .V 3 . The eigenvectors corresponding to 
the eigenvalue I aie therefore of the form ( 4 .V 3 , 2 .Vj, .V 3 ), wheie Xj ^ 0 . 
Therefo’ e, 

£(l) = [(-4, 2, l)l\{0} . 

To find AXXj) -- £(i F \/ 2 ), we wiitc 


This gives 


-1 -1 

2‘1 


r-.vx n 

f.v.-l 

0 1 

0 



= (1 i- 

V2) 1 

_1 2 



LJfjJ 

I.X3 J 

> 

1 

L. 

-1 


2 n 

f-Vi' 1 

ron 

1 

0 

-V2 

0 


1 

= 0 

1 1 

_ 1 

2 

- 

V2J 

L.Vj J 

1 

L 0 J 


Solving this, we get 

£(1 + V2) = t(V2. 0, 1)A{0} . 

Similarly, £(1—^2) = I(— V'2, 0, . 

6.8.2 Theorem If ii is an eigenvalue of an n y. n matrix A, then the set 
— £(X) U {0} ^ a subspace of the vector space FJ of n-tuples of 

complex numbers. 
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is called the eigenspace corresponding to X. The proof is left to the 
reader. Note that is the set of all solutions of the equation Ax » Xx. 

It is clear from Theorem 6.8.2 that if v belongs to E(X\ then every non* 
zero scalar multiple of v is also a member of E{\). Therefore, if 
Vi E £(Xi) and v, E £'(Xi), then {v^, v,} is u, because neither is Vi a non- 
zero scalar multiple of vj nor is y2 a nonzero scalar multiple of Vi. This 
idea does not stop here. It can be further extended. More precisely, we 
have the following result. 

6.8.3 Lemma Let A be a square matrix of order n having k distinct 

eigenvalues Xi, X,, , X^. Let Vi be an eigenvector corresponding to 

the eigenvalue Xt, i = I, 2, ..., k. Then the set {vj, v*, v*} is U. 

Proof : We shall prove this lemma by induction. The lemma is true 
for A: <= 1 , i e. {vj} is u, because ^ 0. Now suppose that it is true for 
k =» r, i.e. {vj, v*, .. , v,} is u. We shall now prove that it holds also for 
A: = r + 1, i.e. {v„ v*, v„ v,.,.!} is u. Let 

«iVi + «,Vj + ... + ttfVr + art.iV,+, = 0 . (6) 

Therefore, + a^v* + ... + a,v, + = 0 , 

i.e. 

"H ••• + + «f4-iVnyf+i = Oj, (7) 

because A is linear and AVi — Multiplying Equation (6) by Xr+i and 
subtracting from Equation (7), we get 

«i(^i Vi-x)Vi + *a(Xi — Vn}Va + + *r(Xr — X^-Ovr = 0 . 

Since {vj, v„ .. , v,} is u and Xj ^ X^*.!, / = 1, 2, 3, ..., r, we get = 0 
=a oj — a a,. Substituting these values of a/s in Equation (6), we get 
Kmi'rfi = 0. Therefore, ttr+x = 0, which completes the proof. | 

We shall now prove a fundamental property of eigenvalues and eigen- 
vectors, which will be useful in the further development of the subject. 

6.8.4 Theorem Let A be a square matrix of order n having n distinct 

eigenvalues Xi, Xj, ..., X„. Let Vf be an eigenvector corresponding to 
the eigenvalue Xi, i = l,2 , ..., n. Then the set {v^, Vj, .. , v«} is a 
basis for the domain space of A. The matrix of the linear transfor- 
mation A with respect to the basis {Vi, V(, v„} is 

~Xi 0 0 ... 0 “1 

0 X, 0 ... 0 

0 0 X3 ... 0 . 

• • • • 

• • • • 

• • • • 

_^0 0 0 ... X,i_ 

Proof: The set {vi, v,, ..., v^} is u by Lemma 6.8.3. Since the 
domain space is n-dimensional, it follows, by Theorem 3.6.7, that the set 
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{Vi, Vi. V|»} is a basis for the domain space of .4. For the second part 
of the theorem, note that i4v, = x,v, = Ov^ -f Ov, + ... + Ov,_i + + 

Ov,+i + ••• + Ov*. Thus, the I'-th column of the required matrix is 

(0. 0 .. , 0)^ . 

t 

i-th place 

Hence the theorem. | 

In such a case the matrix is said to have been diagonalised. 

Problem Set 6.8 

1. Determine the eigenvalues and the corresponding eigcnspaces for the 
following matrices : 

r3 2 41 

r3 n [-0 -I'l I 0 3 1 

(a) I 1 (b) 1 1 (c) 1 1 (d) 2 0 2 

L6 2J LJ OJ l_2 - IJ 

L4 2 3J 
132 1 on 

ri 0 01 ro / I ' 

0 1 0 1 

(e) • 2 1 0 (f) I 0 » (g) 

0 2-10 

L3 2 OJ Li I OJ 

LO 0 0 i._ 

2. Diagonalise the matrices of (b), (cj, and (g) m Problem 1 . 

3. Find the characteristic polynomial of the matrix 

~ 1 0 0 0“ 

-1/00 

/ 2 i -i 0 ' 

_ i — I — 1 _ 

Diagonalise this matrix, if possible. 

4. If X is an eigenvalue of the matrix A, prove that 

(a) X* is an eigenvalue of A* 

(b) X” is an eigenvalue of A" 

(c) aX is an eigenvalue of tuA, wheie a is a scalar 

(d) g(X) is an eigenvalue of giA), where g is a polynomial. 

5. If x is an eigenvector of A corresponding to the eigenvalue X, prove 
that 

(a) X is an eigenvector of A" conesponding to the eigenvalue X* 

(b) X is an eigenvector of g(A) corresponding to the eigenvidue g(x) 
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6. Prove that X = 0 is an eigenvalue of the matrix A iff A is singular. 

7. If X is an eigenvalue of the matrix A, prove that 

(a) X is also an eigenvalue of 

(b) 1 /X is an eigenvalue of A~^, if A is nonsingular. 

8. If X is an eigenvector of A corresponding to the eigenvalue X, prove 
that 

(a) X need not be an eigenvector of A^ corresponding to the eigen- 
value X 

(b) X is an eigenvector of A "‘‘(if A is nonsingular) corresponding 
to the eigenvalue I /X. 

9. Prove that the eigenvalues of a triangular matrix are its diagonal 
elements. 


6.9 WRONSKIANS 


In this article we shall use determinants to discuss dependence anb 
independence of functions. These ideas help in an understanding ot the 
theory of ordinary linear differential equations. First, we shall define the 
Wronskian of functions. 

<S.9.1 Definition If yi,.)'*, • are n functions in *”"*’(/)» then the 


determinant 




yiW 

ytix) 

— .VbW 

W{x)^ 

* 

• 

KW 

••• >»(v> 


yi'"-’>(x) 

yii<»-"(x) 

... y„<«-»(x) 


is called the Wronskian of y*. .. , y„ at x, and is denoted by 
W[yiix),yi{x) ...,y„(x:)]. 

Note that the Wronskian is a function of x. 


Example 6,26 The Wronskian of the functions x ard cos x is 


W[x, cos jc] 


X cos x \ 

~ —X sin X — cos jr . 

I —sin X I 


The linear dependence or independence of the functions yi, y*, ...,y« 
plays an important role in the solution of an ordinary linear differential 
equation. The following theorem tells how the dependence or indepen- 
dence of functions yj, y*, .. , y„ is related to their Wronskian. 

6.9.2 Theorem Let y^, y„ ..., y» € '">(/), and let W(x) be their 

Wronskian, 
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(a) If there exists x, € / such that W{x^) ^ 0, then y^, y, are 
LI over I. 

(b) If there exists x^ € I such that lV{x^ = 0 and ify^, y^, .. , y, 
are solutions of the differentlai equation 

+ a^-if + = 0 , ( 1 ) 

where Oq, ai, •••, On € (/), then yi, y^, are ld over I. 

(c) Ifyuytt yn ore solutions of Equation (1) and are u over I, 
then W{x) nevtr vanishes on /. 

(d) Ifyuyv, — . J'n are solutions of Equation (/), then either W(x) 
— 0 over I or W(x) has no zeros in /. 

Proof : (a) Since ^(^o) considered as a square matrix 

is nonsingular by Corollary 6.5.5. Hence, by Theorem 5.5.2, the column 
vectors 

v.(->fo) = Cv.W. •. / = 1, 2, , n (2) 

are li in F„. Therefore, y^, y\, •••, are li over /, by Lemma 4.9.5. 

(b) If W(xJ = 0, the columns o^ namely, v,(Xo) =- 0',(Xo), 

X(*o). >'.*""”(•>^0)). f = 1. •, a, are ld in V„, by Theorem 5.5.2. There- 

fore, there exist scaltrs C^, C^, ..., C„, not all zero, such that 

”1” C2V2(Xq) 1“ ... -|- 0 . 

This means 

W’‘\xo) + 4 1 C,j;„'*>(xo) -0, k = 0, I, 2, ..., in - 1), 

(3) 

for at least one scalar C* not zero. Consider the linear combination y — 
Qj'i + Qy* + ”• + C„y„. Since •• , y^ are solutions of Equation 
(I), ;; is also a solution of (I). But by Equation (3), we have 

>"(^0) = = ••• = y '” ‘’(^0) == 0 . (4) 

Thus, is a solution of Equation (0 and satisfies the initial conditions (4). 
But the zero function also satisfies Equation (I) and the initial conditions 
(4). Hence, by Theorem 4.9.2 (existence and uniqueness), yix) = 0 for all 
X in I. 

Thus, Cij(’i(x) + C,j’,(x) 4- ••• + O’nC^) = 0 for all x G / and at 
least one C* 0. Therefore, j'l, Js. •• . .^n are ld over /. 

(c) This is the contrapositive statement of (b). 

(d) It follows from (b) and (c). B 

6 9.3 Theorem Ifyi, y^ are solutions of 

fl«y" 4- «!>'' + Oil' = 0 , (5) 

where a^ jj, md a, belong to ^ (/), and a^ is non here zero on /, then 

-rf\dx 

Wlyx(x),ytix)Y^Ce (6) 

Proof : yi and nrc solvtions of (5), Therefore, 
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Also Wl^uy,]^ 


OoJ'* + “0's + 
yi yt' 

I ^ yty* - yjy* ■ 

y't y't I 


So -^ = >',>* + ^-lFs - 7i>s - ylyi = >'0'^ - y^yz 

“0 “0 
Hence, on integration, we obtain 

ff'[y,M,Mx)] -^Ce , 

where C is an arbitrary constant. | 

6.9.4 Remark The foregoing result can be extended to a differential 
equation of the n-th order. Here we state the general result. If 
J'k yx> •• > yn are n solutions of the n-th order normal linear differen- 
tial equation + ••• o»J’ = 0, on aln interval /, 

thcnlf'D'iW,>-2(.T), Ce {7) 

Equations (6) and (7) are known as Abel's formulae. 

Problem Set 6.9 


1. Use the Wronskian to prove that the following sets of functions are 
u over J : 


(a) 

c“, ; a # h ; 

I any interval 

(b) 

m,* m,A w„A . 

V , €? , C , 

m^, m,, ..., itin all distinct 

; / any interviS 

(c) 

1, X, X* ; 

I any interval 

(d) 

l,x,x\ ..., X"-* ; 

/ any interval 

(e) 

c*, sin 2x ; 

I any interval 

(0 

atx cue 

e , xe ; 

/ any interval 

(g) 

e** sin px, e** cos Px ; 

I any interval 

(h) 

In X, X In X ; 

/ = (0, 00). 


2. Use Abel’s formula to find the Wronskian of the linearly independent 
solutions of the following normal linear differential equations ; 

(a) / — 4y' -f 4ji =* 0 

(b) y -f- 2xy = 0 
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(c) (1 - - 2xy + 2;^ = 0; >^,(0) « ;;;(0) « 2, 

3^.(0) =-y;(0) = 1 

(d) A' - W + y==0; y,{-l) = = 2, >-*(-1) = 0, 

3. What is the value of C in Equation (7) if j i, y^, ..., _y„ are ld 7 


6.10 CROSS PRODUCT IN k. 


In this article we shall discuss the product of vectors in Kg, mentioned 
in § 2.3. 


6.10.1 Definition If « = (a^, a^) and v -- (i>i, b^, b^) are two vectors 

in Kj, their cross product, written as u x v, is defined as the vector 


M X V 



I Uj 

> 

I 1*3 



Since the cross product is a vector, it is also called vector product. 
In simplified form Definition 6.10.1 says 

(fli, flg, Oa) X (hi, h.) -- (aA “A - ^1*3. «A - • 

If we use the unit vectors i,j, k, we obtain 
(a, I + aj + aje) x (h,i f bj ■\ bik) 


Oi 


J f 

fl, Ot 

i 1 



bi bi> 

b, hi 


h K 


which is easily remembered in the determinant form 

i J * 

Oi Og Og • 


( 1 ) 


» I ^2 I 

To obtain the cross product we expand (1) in terms of the first row as if 
it were a determinant. Note that (I) is not a ‘pukka’ determinant. 

From Definition 6.10.1 it follows immediately that 
/ X / --= *, / X * - f, * X I -- i, 

j X i = -k, k X i = —i, i X * ^ -j, 

and I X i= 0 x y = k x k. 

Note that the cros5 product is a binary operation on K,. 

Example 6.27 (1, 2,-1) x (0, —1, 3) 



= (5, -3. -1) . 
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6 . 10.2 Tlieoreai (Properties of cross product) Let UtV,w be any three 
rectors in Kj. Then 

(a) tt X V = — (v X «). 

(b) M X (v + w) = M X V + « X iv. 

(c) For « E an X V = a(« X v) = m X av. 

(d) M • (« X v) = 0, and v • (« x v) = 0, i.e. u x v Is orthogomd 
to both u and v. 

(e) l«xvl®— |«l*|v|®— 1 m*v|*. 

Since the proofs are straightforward, we shall prove only (e). 

Proof of (e) : Lei u = (oi, a^) and v = (hi, h*, h,). Then , 
|mI*| v|»- 1« • v|* 

~ (of + o* al)(b\ + hj + h|) — (Oihi + + aj>^y 

= S a*{bl + h*) - 2 2 fliMiha 
= 2 (fl»h| + - 2 2 fl iMA 

= £ (Ojh} 

=> I w X V I * . I 

6 . 10.3 Corollary //6 is the angle between two nonzero vectors u and v in 
Vg, then 

I u X V I = I u I I V I sin 0 . 

Proof : We have 

u ' V ~ I u I I V 1 cos 0 (cf Definition 2.3.3). 

HencCf from (c) of Theorem 6.10.2 it follows that 

|mxv1*=-1m|*1i'|®— 1m1*1v 1* cos® 0 
= 1 M 1 * 1 V I ® sin* 0 . 

So I u X V I — I u I I V I sin 6, since 0 < 6 < n. 0 

Note that | u | | v | sin 6 is the area of the parallelogram formed by 
vectors u and v. Hence, | u x v | represents the area of the paralldo- 
gram formed by u and v. 

DIRECTION OF u X V 

Given two vectors u and v, we have just proved that 

(i) I u X .V I = I » I I V I sin 6, where 6 is the angle between u and v, 
and 

(ii) u X V is perpendicular to both u and v and therefore to the plane 
containing u and v. 

(i) specifies the magnitude of u x v, but (ii) leaves us to decide which 
of the two directions perpendicular to the plane of « and v is the direction 
of u X V. We shall now settle this question. 

We start from the ordered triple of vectors (UU k). Any ordered 
triple of linearly independent vectors (u, v, w) is said to be a positive triple 
if, by ^adually^changing the directions of w, v, w bpt without making them 
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linearly dependent (i.e. without making any of the vectors cross the pten e 
of the other two), we can bring them into coincidence with the directions 
of i,J, and k. Otherwise it is said to be a negative triple. 

Examples of positive triples are 

(ij.k), U,k,i). ik.ij). 

Examples of negative triples are 

(J.i.k), 

6.10.4 Lemma Three linearly independent vectors u = (oi, a^, a,), 

V = (bi, bi, Aj), w — (c„ fj, Ca)form a positive triple iff 

at at <7, 

Ai Ag Ag > 0 . 

Ci Cj 

Proof : A positive triple, which actually coincides with the direc- 
tions of i, J, k, IS of the form 

u - ai, V = A/, w = ck, 
where a, A, and c are positive. So the determinant of the lemma is 

I a 0 0 

0 A 0 = abc , 

0 0c 

which is positive Now any other positive triple is obtained by gradually 
changing the directions of u, v, and w, but without ever making them LO. 
This proces; continuously changes the value of the aforesaid determinant, 
but without ever making the determinant take the value zero (since such a 
value will correspond to making u, v, and w ld ). Hence, every positive 
triple has a positive value for this determinant and vice versa. | 

Now we can see that m x v, as defined, has that direction perpendi- 
cular to the plane of «, v that makes w, v, « x v a positive triple; for the 
determinant of Lemma 6 10.4 now becomes 

fli 

Ag Ag Ag , 

OgAg flgAg flgAj OiAg aibf aj>i 

whose value is 2 (ogA, — OgAg)*, which is positive. 

Thus, ti X V is given by Figure 6.1. 

In other words, if the angle between u and v is 0, 

0 < 6 < Tc, then the direction of « x v is the OM in 
which a right-handed screw would move when rotated 
through the angle 6 from u to v. 
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6.10.5 DeOaltioa If u, v, and w are three vectors in V,, u > (v x w) is 
called the scalar triple product of u, v, and w. 

Note that, even if we remove the parentheses in Definition 6.10.5 and 
write if ' V X w in place of u ■ (v x w), there cannot arise any ambiguity, 
since (« • v) x w is meaningless. (Why ?) 

6.10.6 Theorem (Properties of scalar triple product) Let u — (a^, a,), 

V ss (h„ hj, 63 ), and w = {ci, Cg, Cg) be three vectors in Vg. Then 

' Oi a, Og 

(a) If • V X w = , 61 bg bg . 

< Cl C2 C 3 

(b) W'VXlV = UXV'W = V-WXW==VXW'W 

=-W*MXV=WXM‘V. 

(c) 1 II • V X w \ represents the volume of the parallelepiped formed 
by the vectors u, v, and w. 

Proof : (a) Using the definitions of dot and cross product, we 
have u • V X w 

' ^2 ^8 I ^3 ^1 ^1 ^2 

= 111 I + II 2 "+■ 

1 l ?2 I ^8 Cl C 2 

Ol Clz Oz I 

= bi ftj ^8 ! (by expansion of the determinant in 
terms of the first row). 

Cl C 2 C 3 

1*3 

(b) u.vx w= bi bg bg 

Cg Cg Cg 
bg bg bg 

— Cg Cg Cg (by two interchanges of rows) 

Og Og Og 

= V • w X if . 

Similarly, v - wXff = M' - u x v. 

Thus, u • v X w => V • wxu=w-uxv. 

Since the dot product is commutative, these are also equal to v x w • u 

BtVXtf* V=*ffXV - w. 

(c) If one of the vectors is zero or v x w = 0, the proof is obvious. 
We therefore assume that none of these vectors is zero and so also 
V X w 96 0. 
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Hencct the vector v X iv is perpendicular to the plane detennaned by 
the vectors v and w (cf Theorem 6.10.2 (d)). So either v x w or — (v x w) 
makes an angle ^ < n/2 with u, as shown in Figure 6.2. 



Figure 6.2 

So |«-vxw|= |u| |vxw|cos^ 

= ( 1 « I cos 1 I' X w 1 

— (height of the parallelepiped formed by u, v, and 
w) X (area of the parallelogram formed by v 
and w) 

= volume of the parallelepiped formed by u, v, 
and w. I 

6.10.7 Corollary m • v x w = 0 v, fl/irf w are ld. 

Proof : From the proof of part (c) of Theorem 6.10.6, it follows 

that 

|«*vxw|=l«| |vxw|cos^ 

= i M 1 I V I 1 IV 1 sin 8 cos ^ . 

Hence, « • v x w = 0 means one of the three vectors is 0 or sin 6 =0 
or cos 0 = 0. If one of the vectors is 0, then u, v and w are ld. If 
sin 0 ^ 0 or cos ^ = 0, then the three vectors are coplanar and hence ld. 
So tt • V X w = 0 implies that the three vectors are ld. The converse is 
obvious, fli 

We shall now consider two important applications of the cross product 
to geometry. 

(i) Vector equation of a plane through three given points P„P,, /*3 in 
space : Let Q hea point in the plane PiPjPa (*** Figure 6.3). The vectors 
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PiP, and PfPt lie in the plane. 


The problem now reduces to finding the 



Figure 6.3 


equation of a plane through Pi and perpendicular to the vector 
N = PiPt X PjPs. Hence, the required equation is PiQ • AT = 0, 

i.e. XW = 0. (2) 

This equation is satisfied by all points Q on the required plane and by no 
points off the plane. 

If Pi, Pi, and P* are (jcj, yi, Z|), (or,, y*, Zj), and (xj, y^, z,) respectively, 
then Equation (2) becomes 

X - xi y -yi z - z, 

X* - xi yt-yi z* - = 0 . 

xt -Xi y, - y, z, - z, 

Example 6.28 The equation of the plane through Pi(0, 0, 0), Pi(l, — 1, 1), 
and Pt(2, 1, 2) is 

* y z 

1 -1 1 = 0 , 

1 2 1 

i.e. * — • z = 0. 

(ii) Shortest Stance between two lines : If we have two lines in a 
plane, then either they are paralld^or they intersect. On the other hand, 
two lines in space can behave in any one of three ways : (a) th^ are 
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paralld or (b) they intersect or (c) neither are they parallel nor do they 
intersect. In case (c) they are called skew lines. Let and Z, be two 
skew lines (see Figure 6.4). 



Let Pi, Qt be two points on Li, and Q, two points on The 

v^tor PiQ, X PtQa is perpendicular to both Li and L,. The scalar pro- 

• ■ "► 

jection of PiP» on this perpendicular is the required shortest distance 

between and Ij. It is given by 


PfPj ' PiQi X PjQt 

I KQi X -P. Ca I 


Example 6.29 Let the two lines be 



and Lt ’ 



r -1- 4 


Since Li is parallel to the vector (3, 2, 5), and Lt is parallel tc the 
vector (1, 2, 2), the vector N — (3, 2, 5) x (1, 2, 2) is perpendicular to 
both Li and Lj. We can take Pi as (1, 2, 1) and Pt as (3, 2, —4). 
Hence, the shortest distance between Li and Lt is 
I (2. 0. -5) • (3, 2, S) X (1, 2. 2) | 

1(3, 2, 5} X (1,2, 2)1 




2 0-5 




3 2 S 

1 

-r V35TT+ 16 

1 



12 2 j 

i 


= 1 -12 - 20 1 -r V53 
V53 ’ 


6.10.8 Remark The method in Example 6.29 fails in cash the lines Li and 
Lt are parallel. (Why 7) In this case let Pi and Qi be two points 
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on Li, and Pt a point on Lt (Figure 6.5). Then the scalar projection 
► 

of PtPt on Zj gives 


JAF* • P^QA . 




Problem Set 6.10 


1. Evaluate u x v for the vectors u and v in the following : 

(a) « = I + y + ft, V — 2i — 3y f ft 

(b) u == i - 2k, v = 2j + Ik 

(c) «==(!. 3,0). v = (2, -1,-1) 

(d) « = (-1.2,3).v = (l.l,2). 

2. Prove that 0 X v = 0 for every vector v in F*. 

3. Prove the distributive law « x (v + w) = (u x v) + (« > w) and 
verify it for the vectors u, v, and tv in the following : 

(a) « = f - ?/ + ft. V = 3/ -y, IV = 2/ + / - 4ft 

(b) u = (1, 2, 3), V (3, 0, 1), IV = (2. 4, 5) 

(c) tt = (-1, 1, 2), V = (1, -1, -1), IV = (4, 2. -3). 

4. In the discussion of direction of the vector it x v we have taken 
0 < 0 < n. What happens when 0 = Oor0 = it7 

5. Determine whether the vectors u x v and iv lie on the same side of 
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the plane containing the vectors u and v for the vectors u, v, and w 
in Problem 3. 

6. Find the equation of the plane passing through the three points 

(a) ^(1, 2, -3), B(3, -1, 1), and C(2, 1. 1) 

(b) .4(1, 2, 3), B(3, 0. 1), and C(2. 4, 5) 

(c) .4(1/2, 1, -1), 5(1/2, -1, -1), and C(4, 1/3, -3). 

7. Prove that for vectors «, v, and w of 

(a) (« X V) X W = (« • H')V — (V • M')« 

(b) M X (v X w) - (« • M')v - (m • V)li' 

8 Evaluate the product 

(a X h) X (c X d) 

of the four vectors a, b, c, and d of Fj. Piove that this is a vector in 
the plane of a and b as well as of c and d. 

9 Find the shortest distance between the skew lines 

=^1— r and x = y - z . 

10. Find the equation of the plane containing the line 

1 - 2 

3 2 

and parallel to the line x — y = z. 

1 1 . Show that the line 

X + 1 _ y — 1 _ z i- 2 
2 “ 3 4 

IS paiallel to the plane 

P : 2x ~ 4y -\*2z 3 , 

and find the equation of a line lying m the plane P and perpendicular 
to the line L. 

12. Find a plane through P(l,2, 3) and perpendicular 1o the line of 
intersection of the planes 2jr + 3y — z •= 1 and 3x — y — 7 = 4. 

13. Find a plane through the points P(l,--1,2) and 6(2, 0, 1) and 
perpendicular to the plane 3x — 4y + z - 0. 
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More Matrix Theory 


In this chapter we shall discuss some miscellaneous topics to give the 
reader a glimpse of what lies beyond. The intention is not to give an 
exhaustive coverage but to further our knowledge by giving a brief account 
of the following topics : 

(i) Similarity of matrices; 

(ii) Inner product spaces; 

(ill) Orthogonal and unitary matrices; and 
(iv) Application to reduction of quadrics. 

7.1 SIMILARITY OF MATRICES 

The central idea here is to find out the effect of working with different 
bases in a finite-dimensional vector space V. Let two ordered bases 
F — {ki. Mst •••. «n} and G ={Vi, v», .... v J 
be given in V. We pose the following questions. 

Question 1 Given a vector x £ V, what is the relationship between its 
coordinate vectors [x]f and [xjo ? (Recall Definition 3.6.10.) 

Question 2 Given a linear operator T iV -* V, it has different matrices 
when referred to the different bases F and G. What is the relation b^> 
ween these matrices, namely, (T : F, F) and (T : G, G) 7 

Question 3 Given a coordinate vector (a^, aj, we can construct 

two different vectors 

n n 

X = 1 ciiUi and y = Z oqv< 

/=! /-I 

in y. What is the relation between x and y 7 

Question 4 Given an n x n matrix ico) of scalars, we can define two 
linear operators R and 5 by 
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<1 II 

Riu,) = 2 c„«, and = 2 c„v,, y = 1, 2, .... «. 

<=l 1=1 

What is the relation between R and S ? 

Essentially, these four questions can be unified by asking for the rela- 
tion between 

(i> two coordinate vectors arising from the same element x of P; 

(ii) two matrices arising from the same linear operator on V; 

(iii) two vectors in V arising from the same coordinate vector; and 

(iv) two linear operators on V arising from the same matrix. 

In order to answer these questions we construct the important linear 
operator A on V, which transforms the basis F into the basis G. In fact, 
A : V -*■ y is defined by A{ui) = v„ i = 1, 2, •• , n. Denoting the matrix 
{A : F,F) by («„), we can write the definition of A as 

n 

Vj -- A(u,' = 2 a.,a„ / =- 1,2, • , «. (I) 

i-1 

n 

Note that A is one<-one, since, if x — 2 a,w„ then Ax — 0 gives 

i- 1 

n n ft 

0 ' i4(2 «,«,) - 2 a,i4(u,) ■=■ 2 a,V| 
i-t 1=1 «=l 

or «, =- 0 for all i = 1, 2, •• , n, i.e x = 0. Thus, y4 is a nonsingular 
linear transformation and so (ii(.i) is a nonsingular matrix. This matrix is 
called the matrix of change of basis from the F-basis to the G-basis. 

These four questions can now be respectively answered by the follow- 
ing four theorems. 

7.1.1 Theorem Let x & V. Let [xJf and [xjc be the coordinate vectors, 
written as cohtmn vectors, of x, relative to the bases F and G, respec- 
tively. Then 

ixlf =. (ao)[xl<; , (2) 

nhere the matrix (a,,) is d^ned by Equation (1). 

Proof : Let 

Wf = («li «t» [x]6 = (Pi, Pt p*)*" . 

Then 2 a««( = X = 2 p^v^ = 2 %A{Ui) 
t i J 

= 2 p^ 2 = 2 (2 Pia,,)u< . 

it i J 

Since the Ui's are u, it follows that 

«< = 2 a<^p^, i = I, 2, •••, n, 

J 
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i.e. 






lP« J 


L«n-I 

' This pro\es the theorem, f 

7.J.2 Theorem Ze/ T be a linear opetator on V. Let (T : F, F) be the 
matrix B — (P,j) and (T : G, G) be the matrix C — (y„). Then, with 
(a,i) defined as in Equation (1), 

5(*„) = (a JC . (3) 

In other words, 

B = (a.,)C(«.,)-' . (4) 

Proof : We have 

r(u,) = 2 p„t/„ and T(y,) = 2 y.jV„ j ~ 1, 2, n. 

Now, for each j = 1, 2, n, we have 

Ttyi) = T{A(u,)) , (where A is defined by (1)) 

= I\2aw«*) , (again by (1)) 


= '2titjT(uic) = 2ajy(2p,j,u,) 

k k i 

t k 


( 5 ) 


(by(i)) 


( 6 ) 


On the other hand, for each y = 1,2, •••,«, 

T(v,) = 2Y»,Vfc = 2Y*j/4{Wk) 

k k 

— 2Y«:,2«,HiM< 

k i 

= 2(2«rtYw)«. • 

I k 

Equating (5) and (6) and observing that the u/s are u, we get, for each 
/, I 1, 2, ••*, n, 

= 2«,jjYw • 
k k 

This gives Equation (3) and proves the theorem. | 

7.1.3 Theorem If (ai, oq, ..., »„) is a given coordinate vector and 

2«,u„ y = 2a, v„ then the two vectors x and y are connected by the 
i i 

relation 

Ax 

where A is defined by Equation (1). 

Proof : Since A(u,) = v, for all 1=1.2. .... it. it follows that 


( 7 ) 
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Ax = = ^. j 

7.1.4 Theoren Let (cy) be a given n x n matrix. Define linear operators 
RandSby 

R(Ui) = Ic^fUt andS{Vi) = 2c„v„ \, 2, .... it. 

Then 


SA = AR. 


In other words, 
where A is defined by (1). 


S = ARA ~' , 


( 8 ) 

(9) 


Proof : We have, for each j — I, 2, n, 

(S^)(«,) = S(4(«,)) = S(v,) 

= 2c„v, = ICi,A(u,) = i4(2c„w,) 

= - (.</{)(«,) . 

Hence SA — A R. | 

Equations (3), (4), ( 8 ), and (9) provide the motivation for the fi llow- 
ing definition. 

7.1.5 Definition (a) Two n x n matrices B and C are said to be similar 
if there exists a nonsingular matrix P such that BP — PC or 
B^ PCP -^. 

(b) Two linear operators S and /{ on K are said to be similar if there 
exists a nonsingular linear operator A on V such that SA = AR or 
5 = ARA-K 

In the light of this definition the answers to Questions 2 and 4 can 
now be briefly stated as : The matrices or the linear transformations in 
question should be similar 

Let u^now look at a comprehensive numerical example, which illus* 
trates Theorems 7.1.1 to 7.1.4. 


Example 7.1 Let V = K,. Consider the ordered bases 
F- {(0,1.1), (1,0,1), (1, 1,0)} 
and G - {(-1, -2, I), (1, 3, -1), ( 0 , - 1 , 2 )} . 


(a) Given x — (1, 1, 1), verify lesult (2). 

(b) Given a linear operator J : F, -> K, defined by T{Xx, X|, =s 
(jfi “1“ Xj, Xx 2xj 4 ” X 3 , Xj Xx), verify result (3). 

(c) G.ven the coordinate vector (4, 5,-1), verify result (7). 

(d) Given the matrix 
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verify result (8). 

First, we have to construct the matrix (a^) defined in Equation (1), 
corresponding to the linear transformation A: given by 

mi,l)*(-l, -2. 1), ^(1,0,1)=(1.3,-1). ^(1,1,0) 

= ( 0 .- 1 , 2 ). 

So we have to find a<,’s such that 

«ii(0. 1. 1) + «.i(l, 0. 1) + a„(l. 1, 0) = (-1. -2, 1) 

«it(0. 1, 1) + «h( 1, 0, 1) + ct„(l, 1, 0) = (I, 3. -1) 

«ia(0. 1. 1) + «„(1. 0, 1) + «„(1, 1, 0) = (0, -1,2). 

In other words, we have tQ.solve the following three systems, each of 
three equations in three unknowns : 

Ooi+P+Y=-1 1 0 

« + op + Y = -2 3-1 

«+ P + 0y= 1 -1 2. 

The matrix for these three systems is 

“011 -1 1 bn 

10 1 -2 3 -1 . 

_1 1 0 1-1 2 _ 

Applying the row reduction process to this matrix, we get 

“100 0 i j- 

0 10 1 -t I . 

LO 0 1' -2 

r 0 i *“i 

So (a«) « 1 -I I . 

L-2 t -t_t 

(a) Let [x]f be («i, Ut, Then 

(1, 1. 1) = «i(0, 1, 1) + 0,(1, 0, 1) + «,(1. 1, 0) . 

From this we get «i = 1/2 «= «, = 

Let We = (Pi, Pi, P^^* Then 

(1. 1. 1) = Pi(-1. -2, 1) + P.(1. 3. -1) + p,(0, -1, 2) . 
which gives Pi = —1, Pi = 0, p, = 1. Thus, 

1*1f = (i. h iF and [xle = (- 1. 0 , l)r. 

We have now only to chedc 
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" 1 


r 0 

1 

r 


-n 

1 


1 

-1 

1 


0 

L 1 _ 


L-2 

1 



1 _ 


which is easily verified. 

(b) We have to compute the matrix B = (T : G, G) = (p«). First, 
observe that, from the hypothesis, 

IXO, 1, 1) = (1, 3, 1), r(l, 0, 1) (2, 2, -1), and 7X1, 1, 0) = (1, 3, 0). 

The scalars p,/s then satisfy 

(1. 3. 1) = MO. 1. 1) + MU 0, 1) + MU U 0) 

(2, 2, -1) = MO, 1.1) + Ml. 0, 1) + MU U 0) 

(U 3. 0) = MO U 1) -f MU 0, 1) + MU U 0) . 

To find the p,/s we have to solve three systems, each of three equations in 
three unknowns. Setting up the matrix for the row reduction process, we 
get 

“011 1 21“ 

s 10 1 3 2 3 

LI 10 1 -1 0_ 

which, on row reduction, finally leads to 

“10 0 I n 

0 10 -4 -1 

LO 0 1 112 

- I -1 1- 

Hence, jj = (M = -1 -i -1 

_ I 1 2J 

Again, to compute the matrix C a= (T : (7, G) = (y«), observe that 
7X-U -2, 1) = (0. -4, -1), r(l. 3, -1) - (0, 6, 2), and 7X0, -1.2) 
= ( 2 , 0 . - 1 ). 

The equations to be solved here are 

— a + p =00 

— 2« + 3p — Y = — ^ 6 

a - p + 2 y = -1 2 

The matrix of this system is 

r-1 1 0 0 

-2 3 -1 -4 

_ 1 -1 2 -I 


2 

0 
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which, on row reduction, finally leads to 

ri 0 0 -I 7 -V“ 

010 7 -I . 

-001 -i 1 iJ 

--i 7 -v~ 

Hence, C = (y«) = — f 7 — f . 

--i ‘ i- 

It is now easy to verify that = (««)C. 

(c) X = 2«.«, = 4(0, 1. 1) + 5(1,0, 1) - (1, 1, 0) = (4. 3. 9) 

y = W, = 4(-l. -2, 1) + 5(1, 3, - 1) - (0, -1, 2) = (I. 8. -3) . 

Now Ax = .4(4, 3, 9) = .4(4(0, 1, 1) + 5(1, 0, 1) - 1(1, 1, 0)) 

= 4m 1. I) + 5.4(1, 0, 1) - .4(1, 1, 0) 

= 4(-I, -1, 1) + 5(1, 3, -1) - (0, -I, 2) 

= (1.8, -3)=>-. 

(d) We have (S.4)(0, 1, 1) == S(.4(0, 1, 1)) 

= 5(-I, -2, 1) = Icnv, 

i 

= l(-i,-2.1)-l(0.-I,2) 

= (-l,-l.-l) 

and M«)(0, 1. 1) = A(m 1. D) = AlSc^^u,) 

= X(1(0, 1,1)- 1(1,1,0)) 

= m.l. l)-i4(l.l,0) 

= (-1. -2, 1) - (0. -1, 2) = (-1. -1, -1) . 
Similarly, we could check that iS.4 and AR coincide on the other basis 
elements Ut and Uj also. Hence, iS.4 = AR. 

Problem Set 7.1 

1. Repeat Example 7.1 fdr the following data : 

F= F, 

F = {(l.-l),(l, 1)} 

G = {(2. -3), (3, 3)} . 

(a) * = (1, 0) 

(b) r : Ft -> F„ TXxj, x,) = (x^ + x„ Xi - x,) 

(c) The given coordinate vector is (— 1, — I) 
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r -1 - 2 -] 

(d) The given matrix is I |. 

L 2 -IJ 

2. Repeat Example 7.1 for the following data : 

F = {(1, 1. 0, 0), (1. 0, 1, 1). (0. 0, 1. 1). (1, 0. -1, 0)} 

G — standard basis. 

(a) * = ( 1 . 1 , 1 , 1 ) 

(b) T : Vt, 7T(*j, **, *a, * 4 ) = (*i + *» + *j + *4, 0, 0, 0) 

(c) The given coordinate vector is (I, —2, 3, 0 ) 

(d) The given matrix is 

r 1 0 0 n 

-1110 
0 0 0 -1 

L 1 -2 3 4J 

r^io 2n m on 

3 . Prove that is s milar to 1 1 via the nonsingular 

L 2 7J L 0 6 J 

matrix 

r 2 1 1 

•v/5 \/5 

_L --2 

LVS V5J 

r 1 2 - 2 n r 3 0 o~ 

4. Prove that 2 1 2 is similar to 0 3 0 viathenon- 

__2 2 1_ LO 0 — 3_ 


5. 


singular matrix 


0 

V6 

V3 

1 

1 

1 

V2 

V6 

V3 

1 

1 

1 

LV2 

V6 

V3J 


Prove that 



7 

-1 

-ion 


r6 

0 

on 


-1 

7 

10 

is similar to 

0- 

-12 

0 


-10 

10 

-2_ 

1 

LO 

0 

18_ 
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via the nonsinguiir matrix 


6. Prove that similar matrices have the same eigenvalues. 

7.2 INNER PRODUCT SPACES 

In § 2.3 we talked about the orthogonality of vectors in ^2 and In 
this article we shall gene^'alise this concept to all finite-diir.-ensicnal vector 
spaces and to certain more general spaces called inner product spaces. 

7.2.1 Definition Let K be a (real or complex) vector sp ce. An inner 
product on V assigns to each ordered pair of vectors u, v in V a 
scalar (complex if is a complex vector space and reul if K is a leal 
vector sp'ice), written as « • v, satisfying the following properties : 
(IPl) u • (y + w) u • V + u • w for all w, V, w *0 K 

(IP2) (olu) • V = a(ii v) for all w* v £ F and all 

scalars a 

(IP3) w • V ~ V • w 

(iP4) u u 0 and u u = 0 iff u 0. 

7.2.2 Definition A vector space V together with an inner product is called 
an inner product space. 

A finite-dimensibnal real inner product space is called an Euclidean 
space and a finite-dimensional complex inner product space is called a 
unitary space. 

We shall now give some elementary consequences of Definitions 7 2.1 
and 7.2.2 in the form of a theorem. Note that we state the results for 
complex inner product spaces. The corresponding results for real inner 
product spaces are obtained by merely omitting the complex conjugations. 

7.2.3 Theorem Let V be an inner product space, u, v, and n be any three 
vectors in F, and a a scalar. Then 

(a) {u + v) • w = u • w + y * w. 

(b) u • (av). = a(u • v). 

(c) 0 • « = 0 = « • 0. 

Proof ; (a) (w + v) • w = w • (m +” vy = w • m + w • v 

5= W • I# + W • V ^ u • W + V • w . 


1 

1 

1 ~] 

V2 

V6 

V3 

1 

1 

1 

V2 

V6 

V3 

0 

2 

1 

V6 

V3J 
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(b) II • («id = (av) • u = a(y • u) 

= «(y • «) = «(« • v) . 

(c) 0 :j£ «= (Oy) • M = 0(y • «) = 0 . 

The second part of (c) can be proved similarly. | 

Example 7.2 In we can define an inner product as follows : 

If II = (xi, Xt , .... x„) and y = (yi. J'*. .y»), then 

11 • V = + x,yt + ... + . (1) 

For a real vector space V^, the analogous inner product is 

« • y = Xi^i + x^y, + ... + x^y„ . (2) 

Note that this has already been defined (cf Definition 5.4.2). 

It IS routine to verify that Equations (1) and (2) are inner products on 
and Fn, respectively. Clearly, the familiar dot product on F, and F, 
is a special case of the inner product thus defined on F^. Therefore, Fy 
and Fg, endowed with the usual dot product, are inner product spaces* 
This also explains why we use the notation ti • v for the inper product in 
general inner product spaces. 

7.2 4 Remark If ti and v are considered column vectors, then u • y can 
also be written as the matrix product u'^v. On the other hand, if 
they are considered row vectors, then u • v = uv^. 

7.2.5 Remark The inner product defined in Example 7.2 is called the 
natural inner product on F$ (F„). Problem 5, of Problem Set 7.2, 
gives another inner product on F„. 

Exam] le 7.3 Consider the vector space <g^[0, 1]. Define 

/ • « - l\At)g{t)dt , 

where /. g £ ^[0, !]• It can be verified that this is an inner product on 
the space. 

Analogously, on ^ (0, I] we can define an inner product 
c 

/ • g = i\Am)dt . 

Let F be an inner product space. Then for each vector u € F, ii • ii 
is a nonnegative real number irrespective of whether F is a tteal or a cosn- 
plex vector space. We write 

II II II = V(« • «) (3) 

and call it the normut^M. In Examples 7.2 and 7.3 we have 
8 (Xi, Xi, *») 11 - ( I *1 1 * + I I • + ••• + I x« I 

ll/ll = (j* lAO I •*)*'* 


and 


(4) 

(5) 
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Equation (4) suggests that the norm of an element u may be considered 
the ‘distance of u from the zero of the space’ or the ’length of the vector 
w’. We shall, without further ado, call || u || the laigth of u even in the 
general case. The properties satisfied by || u || in an inner product space 
are given in the following theorem. 

7.2.6 Theorem Let V be an inner product space. Then for arbitrary 
vectors u and v in V and scalars «, 

(Nl) II aM II = I a 1 II u II 

(N2) II « II > 0 and II w II = 0 af II = 0 

(N3) I ti > V |< II tf II II V II 

(N4) II M + V |1< II 11 a + II V II . 

(N3) is called Schwann's inequality and (N4) is called the triangle 
inequality. The triangle inequality simply generalises the familiar 
geometrical fact that in a triangle any side is less than the sum of the 
other two sides. 


Proof: (Nl) || aw |1 * = (aii) • (ati) = faSK" * «) 

= I « I 

which gives (Nl). 

(N2) This is a restatement of (IP4). 

(N3) This is clearly true if u = 0. Suppose u # 0. Consider 

W = 9 — 9U , 

wker. «- Il»n 

0 < II w II • = w • w = (r — all) • (v — a«) 

= V • V — V • (««) — (all) • V + (all) • (all) 

s= V • V — '(v • u) — a(ii • v) + (aaXii . u) 

= 11 V II • — a(v • «) — a(li • v) + I a I * II II II • . 

Substituting the value of a, u e get 


0 < a V II 


2| V . Ill* 




which gives (N3). 


(N4) B « + V a * = (« + v) • (u + v) 


= II»«+II»V+V»II + V»? 

= II-II + II*V + II*V+V*V 

« a « a • + 2 Re (II • y) + II v B * 

<B«ll* + 2|ii •vl+Bfa* 

<B«B* + 2B«B BvB + BvB* (i»y(N3)) 
“(Bull + ByB)*, 


Wllicb gives (N4). | 
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Now we aie ready to take up the concept of orthogonality of vectors 
in a general inner product space. Note that these ideas have already 
been developed for Vg and F, in § 2.3, where we used the dot product 
without mentioning that it is an inner product on the space concerned. 

7.2.7 Defloition (a) If u and y are two vectors in an inner product space 
V, they are said to be orthogonal if w • v 0. 

(b) A set of vectors is said to be orthogonal if each pair of distinct 
vectors of the set is orthogonal. 

7 2 8 Theorem Any orthogonal set of no zero vectors in an inner preset 
space is li. 

Proof : Let A be an orthogonal set and B = {ux, Uj, .... u„} be a 
finite subset of A. Consider 

«1«1 + «*«» + •• + an«» = 0 . 

Then, for every i = 1, 2, ...» n, 

0 = 0 • tf, 

— («iUi + + . . + »tMn) * U* 

= ai(M, • «,) + a,(wj •««)+ — + «»(«» ■ «•)' 

= «,(«, • «,), since «, • u, — 0 for i 

Since ^ 0, we get = 0. Hence, every finite subset of is u and 
therefore A is Ll. fl 

The converse of Theorem 7.2.8 is not true. In other words, not every 
linearly independent set is orthogonal. This can be seen from simple 
examples, such as 

{71, 21 + 3y} 

in Ft. But, given a linearly independent set, we can arrive at an ortho- 
gonal set in a standard way, which is very important. This construction 
is called the GramSchmidt orthogonalisation process. We build this in 
the proof of Theorem 7.2.10. But first we shall introduce the concept of 
vector projection, analogous to the situation in Ft and Fj (cf Theorem 
2.3.8). 

7.2.9 Deflnitioa If » and y belong to an inner product space F and 
V 7^ 0, then the vector 


u • y 



is called the vector projection cf u along v. 

7.2.10 Theorem Every ftnite-dimensional inner proAtet space has an 
orthogonal basis. 

Proof: Let {«i, tit, ..., «•} be a basis of the inner product space 
F. We shall construct an orthogonal set {yi, y|, ..., y«} of vectors in V, 
whidi is a basis for V. Write Vi » tix. To construct Vi, subtract from tit 
its vector projection along Vt. So 
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This gives Vt • = 0 and so {vi, Vg} is an orthogonal set. 

Now to construct vg, subtract from >/, its vector projections along Vg 
and Vg. Thus, 


Vs = «8 - 


«3 


.‘'l V, - 

I! 2 


V, 


V, 11 ‘ ‘ II Va I 

This gives V 3 • = 0 = Vg • Vg. (Check.) Hence, {vj, Vj, V 3 } is an 

orthogonal set. Observe that we have so far used only three of the 
vectors of the given basis. Proceeding thus and using all the vectors 
W 2 > •••» we construct the orthogonal set B ■= {vj, Vg, v„}, where 

/-I 




Ui - 1 

7-1 


II V, 


“i v„ i 2, 3, 


None of the vectors of B is zero, because if Vk were zero, then w* would 
be a linear combination of Vj, Vg, and therefore of Wi, ttg, 

By Theorem 7.2.8, B is a linearly independent set and hence a basis for 
the.if-(limensional space F. 


7.1.11 Definition An orthogonal set of nonzero vectors {wi, i/g, •• , !/„} is 
said to be orthonormal if |1 m, n ~ 1 , 1 ~ J, 2, ..., n. 

Clearly, {/,/,*) is an orthonormal set (in fact, basis) of Kg. From 
Theorem 7.2.10, it follows that every finite-dimensional inner product 
space has an orthonormal basis. 

7.2.12 Remark In the On m-Schmidt construction, described in the proof 
of Theorem 7.2, 10, we started with n vectors, which formed a basis 
for V, Even if we had started with fewer than n elements, the 
construction would have worked, provided those elements were li. 
The resulting set would have been merely an orthogonal set and 
not an orthogonal basis. 

In Example 7.4 we shall apply the Gram-Schmidt construction to 
produce an orthonormal set from a given linearly independent set (which 
is not a basis). 


Example 7.4 Orthonormalise the set of linearly independent vectors 
{(1, 0, 1, 1). (-1, 0, ~1, 1), (0, -1, I, 1)} of K,. 

Let Vj = (1, 0, 1, I). Then 

V. = (-1. 0, -1. 1) - D (i. o, i, i) 

= (-f. 0, -f. t) . 

V, » (0, -1, 1, 1) - \ 0 (1, 0. 1, 1) 
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I, ,) ,(-2,3,0. -2,3. 4,3) 

= (- 1 , 2 ,-!. - 1 , 2 . 0 ). 

The resulting^orthogonal set is 

{(1. 0, 1, 1), (-2/3, 0, -2/3, 4/3), (-1/2, - 1, -1/2, 0)} . 

The conesponding orthonormal set is 

{(1/V3,0, 1/V3. 1/V3). (-1/V6,0, -1/^/6. 2/V6), 

(-l/v/3,-2/V3.-W3,0)}. 

Example 7.5 Find an orthonormal basis of £^ 3 [— 1, 1] starting from the 
basis (1, X, X*, x*}. Use the inner product defined by 

We take v, = 1. 

X . 1 


Then 


1 


— X — (J /|_j tdt) — X . 


V, = X* 


2 2/3 

X* - i /!., t^dt - ^x t*dt --- X® - i 


= V* 


= X* — |x . 




2/3 


X - 


X» • (X‘ - 1/J) 
2/5 


(X*- J) 


Thus, the orthogonal basis is 

{1, X, X® — J, X® — fx} . 

To get the corresponding orthonormal basis, we divide these by the res* 
pective norms and get 

f I VS 3\/5 . 2 _ 1\ hll (jjS _ j;t)| , 

t.V2’ V2 ’ 2V2 ^ 2V2 ^ * 7 


Problem Set 7.2 

1. Use the Gram-Schmidt process to orthonormalise the linearly inde- 
pendent sets of vectors given in Problem 1, Problem Set 3.5. 

2. Repeat Problem 1 for Problem 2, Problem Set 3.5. 

3. Repeat ProUem 1 for Problem 3, Problem Set 3.5. 

(Take the inner product in the space to be /!_. 

4. fn an inner product space V show that 

(a) If » • II «= 0 for aU « € F, then V = 0 
. (b) If » • « = w • II for all « G K, then v = w. 
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5. Show that an inner product can be defined on F| by 

• (y.. yj = . 

In this inner product space calculate' 

(a) Cl • e, (b) (1, -1) • (1, 1). 

6. (This is a generalisation of Problem 5.) Let S be a basis of an 
it*dimensional vector space V. Define, for arbitrary x, y £ V, 

X ‘ y =• [x]a • bin. 

where the inner product of coordinate vectors on the right-hand side 
is the natural inner product of Prove that this definition gives 
an inner product on V. In this inner product space prove that the 
basis B is orthonormal. 

7. Prove that all the eigenvalues of a symmetric matrix are real. 

8. Let the set {v„ v,, v„} be ld. Vi'hat happens when the Gram- 

Schmidt process of orthogonalisation is applied to it ? 

7.3 ORTHOGONAL AND UNITARY MATRICES 


We shall discuss two special types of matrices in this article, and 
assume the natural inner product on F« and 

7.3.1 Definition (a) A real square matrix H is called an orthogonal 
matrix if 


HTh = / = Hir . 


In other words, IP = . 

(b) A complex square matrix U is called a unitary matrix if 
V*V = I ==UV*. 


In other words, U* = U~K 
For example, 

f“ cos 0 sin 0n 
I I is orthogonal and 

L.— sin 0 cos 0_i 


L _L“I 

V2 V2 

J_ J_ 
Lv'2 VZJ 


is unitary. 


Orthogonal and unitary matrices are important because they corres- 
pond to certain linear operators that have significant properties. But, 
since we shall not be discussing such operators in the general setting of a 
vector space, we shall be content with deriving certain fundamental 
properties of orthogoiul and unitary matrices. 

7.3.2 Theonas A real {complex) sqyuue matrix Is orthogonal {unitary) iff 
the rows of the matrix form an orthonormal set of vectors or ^ the 
columns of the matrix form an orthtmormal set of vectws. 
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Proof : We shall prove the theorem for the complex case. By 
removing all the complex conjugations in the proof, we get the proof for 
the real case. 

Let Ui, Ut, ...» u« be the column vectors of a complex square matrix 
U. Then 


U =- [«! Uj ... and U* == 


«r "1 

ul 


L- «; 


where «, («i„ and «f = Uu, •••. m»<)- 

So V*U^\ - lltt, 




«r“i «r«t 

^ ulut efu, 

• # 

• • 

• « 

This is the identity matrix I iff 


«f«n 

uTUnJ 


ilTUj — 0 ioxif-j 

and V^Ui — 1 for all i — 1, 2, •••, n. 

This means that the set of column vectors {«i, «a» ...» «»} is orthonormal. 

To prove that this requirement is equivalent to saying that the rows 
are orthonormal, we have to note only that V*U = I implies VU* == / 
(and vice versa), and this latter is true iff the columns of U* are ortho- 
normal. I 


7.3.3 Theorem (a) The orthogonal n n matrices form a grotgf for 
multiplication. 

(b) The unitary n X n matrices form a group for multiplication. 

The proof is left to the reader. The groups mentioned in the theorem 
are called the orthogonal group of order n and the unitary groqp Of order 
n, respectively. 

We shall end this article by giving a definition. 

7.3.4 Definition (a) Two square matrices A and B of the same order 
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are said to be orthogonally similar i[ A — HBH-^ for some ortho* 
gonal matrix H. 

(b) Two square matrices A and B of the same order are said to be 
unitarily similar if ^ — UBU~^ for some unitary matrix V. 

Problem Set 7.3 


1. If A is orthogonal, prove that det A — ±1 . 

2. If U is unitary, prove that | det A | — I . 

3. If U is unitary, show that U, and A* {k a positive integer) are 
also unitary. 

4. If A is orthogonal, show that A*” and A* (k a positive integer) are 
also orthogonal. 

5. Show that 


. 6 . 

7. 


8 . 


ro in ro -n n 


I I > I I > I 

Ll OJ Lf OJ LO 



arc unitary, involutory, as well as Hermitian. 

Prove that if A is unitary and U*AV and U*BV are both diagonal 
matrices, then AB = BA. Is this result true if A is replaced by a 
real orthogonal matrix A 7 


Let T be the linear operator on V 3 defined by T(x, y, z) = (x', y', 2 '), 
where x' — x cos — y sin y' = x sin ^ + y cos z' = z, with 
respect to a cartesian coordinate system. Prove that Tis given by 
an orthogonal matrix. 


True or false ? 

(a) Every real symmetric matrix is orthogonal. 

(b) Every Hermitian matrix is unitary. 

(c) If for a complex matrix A, A A* — A*A, then A is unitary. 

(d) The eigenvalues of a unitary matrix have absolute value 1. 

(e) If a matrix is unitary, it is also Hermitian. 

(0 The columns of 


r 1 

i 

V2 

V2 

1 

1 

_V2 

V 2 J 


form an orthonormal set of vectors. 


7.4 APPLICATION TO REDUCTION OF QUADRICS 

In this article we shall use the concept of an orthogonal matrix to 
redtice a real symmetric matrix to the diagonal form by a similarity 
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transformation. An analogous reduction of Hermitian matrices to 
diagonal form by a similarity transformation using unitary matrices is 
possible; such a reduction and related topics are covered in advanced 
textbooks. Since the problem of reduction of a real symmetric matrix to 
diagonal form is the same as the geometrical problem of reduction of a 
quadric to its principal axes, we start this article with a discussion of the 
geometrical aspect. 

In 2-dimensional analytic geometry the equation of a central conic 
referred to its c.ntre as origin is of the form 

flx* 2hxy + by* - k . 

This can be written in matrix form as 

ra h-\ rxi 

j'] 1 I I \ = k . 

L.h bj LyJ 

In 3-dimensional analytic geometry a similar equation represents what 
is called a central quadric. It is of the form 



In detail, this equation is 

ax* + by* + cr* + 2fyz + 2gzx 1 - 2hxy - k . 

In general, even in n dimensions, we can write a similar equation. 
The surface represented by it is called a quadric in n dimensions or simply 
a quadric. Its equation is of the form 

u Au — k , 

where 

jr, 

« == 

and i4 is a real symmetric matrix of order n. 

In discussing a quadric in we shall use geometrical ideas like 
tangent and normal. A tangent to a quadric is a line that meets the 
quadric at two or more coincident points. If a straight line is perpendi- 
cular to the set of all tangents at a point, we say it is a normal at the 
point. We assume the natural inner product on and begin with a 
fundamental lemma. 

7.4.1 Lemma Ifu^ is a point on the quadric = k, then the normal 
at «• is in the direction of Au^. 
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Proof : Figure 7.1 represents 
the situation in the 2-dimensjonal 
case. Let £ = {«o + I ^ 
be an arbitrary tangent, in the 
direction of v, at Uq on the surface. 

L clearly passes through ihe point 
I/,. Any other point, say Ug + tv, 0 
where this line L meets the quadric, 
will be given by those values of t 
that are roots of (u„ + 

(«, + tv) = k. This is a scalar 
equation, though written in matrix Figure 7.1 

form. It simplifies to 

+ tv^Au^ + «yi4(tv) + Pv^Av = k . 

But uIAUq — k, since u, lies on the quadric. So the equation becomes 
t(v^AUa + u^ilv) + Pv^Av = 0 . 

One root of this is r = 0, which corresponds to the point Uq itself. In 
order that L may be a tangent to the surface, we require the other root 
also to be zero. This gives 

v^AUq + u\Av — 0 . 

But vMu, and u^Av represent the same real scalar. Hence, 

vMmo = 0 = uJAv . 

The first equation means idug is perpendicular to v, i.e. to Uq + iv, an 
arbitrary tangent at Ug- Thus, .>4ug is perpendicular to all tangents at Ug. 
In other words, Aug gives the direction of Ae normal at Vg. | 

Let tfg be a point on a quadric. Then the vector Ug is said to deter- 
mine the direction of a principal axis if it is normal to the quadric at the 
point Ug. By Lemma 7.4.1, it follows that the principal axes are in the 
direaions Ug, where .^Ug = hUg for some real scalars X. Thus, we have 
established the following theorem. 

7.4.2 Theorem In the guadi ic uTAu = k the principal axes of the quadric 
are in the direction of the eigenvectors of A. 

Exanqtle 7.6 Find the directions of the principal axes of the conic 
lOx* + 4xy -I- ly* = 100 . 

In matrix form this is written as 

rio 21 r*“i 

[* yl I II 1 = 100 . 

L 2 7J LyJ 

no 2-1 

The eigenvalues of A — | | are given by 

L 2 7 J 
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10 -X 2 

= 0, 

2 7 -X 

which gives X = 11, 6. 

Corresponding to the eigenvalue X = 11, the eigenvectors are given by 

r -1 21 rxi ron 

I I I == I l . 

L 2 -4J Lj-J LOJ 

r2-i 

This gives an eigenvector | | . 

LU 

Again, corresponding to the eigenvalue X — 6, the eigenvectors are 
given by 

r4 2 n rxi ron 

I II l = l I. 

L2 IJ LyJ LOJ 

r in 

This gives an eigenvector j | . Therefore, the axes of the conic are 

L-2J 

along the directions (2/ + j) and (i — 2j). 

In Example 7.6 we have determined two eigenvectors corresponding to 
two distinct eigenvalues. Naturally they are orthogonal. Let us normal* 
ise these vectors and construct the matrix 


= H (say). 


Observe that this is an orthogonal matrix (since its columns are ortho* 
normal). Use this as a similarity transformation on the given symmetric 
matrix 

no 21 

/I = I I- 

L 2 7 J 

Calculate IVAH. We obtain the matrix 

rii on 

\ I. 

L 0 6 J 

Note that this matrix is a diagonal matrix whose diagonal elements are the 

rio 2n 

eigenvalues of A. Thus, A — \ I is orthogonally similar to the 

L 2 7 J 

m on 

diagonal matrix D = \ I . The passage from ^4 to D is called 

L 0 6j 


r 2 

I ~ 

V5 

V5 

I 

2 

LV5 

V5J 
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diagonalisation. The geometrical ioiplication of this diagonalisation can 
be understood by going back to' the equation 

10;c* + 4xy + 7;^ « 100 . 

This equation contains tne xy term; so we do not know the exact size and 
lomtioo of the conic except that it is an ellipse, since its discriminant 
h? — ab — --66 < 0. To find the length of the axes we transform the 

tach r*'n 

coordinates | | to the new coordinates | i by the formulae of trans- 

lt'J l/j 

formation 

X == x' cos 0 -j- >>' sin 6 
y = —x' sin 8 + / cos 6 , 


where 6 is the angle of rotation of the axes. We know from analytic 
geometry that if 6 is suitably chosen, the xy term will vanish in the new 
coordinates, and the lengths of the axes can be found by inspection of the 
transformed equation. The theorem on the reduction of a real symmetric 
matrix, which we shall now prove, will produce this value of 6 without the 
belf of geometry. This theorem of linear algebra says that the required 

rx-\ rx'-\ 

transformation matrix from | | to | | is nothing but the orthogonal 

Ly.J Ly'J 

matrix obtained from the normalised eigenvectors of A. In Example 7.6 
it is just 

r 2 

H. . 

1 

LV5 V5J 


Usijtg this, we get 


Write this as u = 
simplifies to 


1 

rxi 

1 1 

r 2 

V5 

1 1 
V5 1 

rx'-] 

1 

1 1 — 

1 

2 

L/J 

-V3 

V3J 


Hv. Then urAu 

= k becomes vW^AHv 


k. This 


i.e. 


or 


rii 01 r*' 

[*' /]l II, 

LO 6J L/ 
lljc'* -h 6/* = 100 


= 100 . 


(10/Vll)* (10/V6)* 


1 . 


This is an ellipse with lengths of semiaxes 10/Vi 1 and lOfy/b. This 
Mudysis shows that 
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(i) the eigenvectors of A give the directions of the principal axes of the 
conic; 

(ii) the eigenvalues X, and X, of ^4 specify the lengths of the semiaxes 
y/i^i and 

(iii) the orthogonal matrix H constructed out cf the normalised eigen- 
vectors of A is the matrix that reduces A to the diagonal form; and 

(iv) the matrix A is orthogonally similar to a d agonal matrix, whose 
diagonal elements are the eigenvalues of A. 

We shall now prove that this situation is true in the n-dimensional 
case also, at least for the case where the matrix has d istinct eigenvalues. 
The result of the theorem is true even for general real symmetric matrices. 
But we lease the theoretical development of this case to more advanced 
textbooks. 

7.4.3 Theorem (Diagonalisation of a real symmetric matrix) Let A be a 
real symmetric matrix with distinct eigenvalues. Let the normalued 
eigenvectors of A be written as column vertor.v oj a matrix H. Then 

(a) H is orthogonal. 

(b) H^AHi-D) is a diagonal matrix, whose diagonal entries are 
the eigenvalues of A. 

(c) A is orthogonally similar to the diagonal matrix D. 

■ Proof : (a) First, we prove that the eigenvectors of A corresponding 
to distinct eigenvalues are orthogonrl. Let «j and h* be e genvectors 
corresponding to distinct eigenvalues X, and > 2 , respectively Note that 
both are real (sec Problem 7 , Problem Set 7 2). Then 

(Xx - XjXMj • Ms) = X,(Ui - Ut) - XjCUi • Mj) 

— (XjMi Mj) (Wi • X 2 U 2 ) 

-- (^Ml • «*) - (Ml • AUt) 

- {AUiYUt ~ Mj’(i4M,) 

= ulA^Ui — ulAUt 

= 0 (because A^ = A), 

Since Xi gt X*, it follows that Mi • m* = 0. This coupled •, ith Theorem 
7.3.2 shows that H is an orthogonal, matrix. 

(b) H = [Ml Mj ... M„] , 

where Ui are the eigenvectors of A written as column vectors. 



-«rn 

F ufA 


ul 

ulA 

So mA = 


A = 


U^J 

a 

1 
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~(AuiY n ~i 

(Au,) I (X,«,)r I 


(^»«*)^ (where the X/s are the corres- 
ponding eigenvalues) 


L(>4«„)»’J UKUnY-l 

rx, 0 ...on ru[~i 


LO 0 ... X„J Lurj 

- J)//r DH ^ . 

J!ence, H^AH — D as required. 

(c) 1 his is only a restatement of (b). g 
Example 7.7 Reduce the quadric 

“ 7-1 -101 r^n 

[xyz\ _i 7 10 >- = 36 (1) 

_-10 10 -2J Lz_ 

to its principal axes. Note that when this equation is written in full it 
takes the form 

7x* -t- ly'^ - 2z* + 2Qyz - 20zx - 2xy = 36 . 

According to the preceding discussion we need to reduce the matrix 


— 

7 

-1 

-10“ 

- 

-1 

7 

10 


10 

10 

-2J 


to the diagonal form. The eigenvalues of A are 6, —12, and 18. The 
corresponding eigenvectors are (1,1,0), (1,— 1,2), ard (I, — 1, — 1). 
Hence, the normalised eigenvectors are 

(l/v?, 1/V2, 0),(l/v'6, -l/V6.2/v'6). and(l/v3,-l/V3, -1/V3). 

These three vectors give the following orthogonal matrix 



r 1 

1_ 

1 “i 



V6 

V3 

jy = 

1 

1 

1 

V6 

V3 


. 0 

2 

1 


V6 

~v-$J 
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Heace, H'^AH 


Vi 

V2 

0 

1 

1 

2 

V6 

^/b 

V6 

I 

1 

I 

LV3 

V3 

V3J 


r 7 -I -ion 

I -1 7 10 

L-IO 10 -2_ 

-6 0 on 

= 0 -12 0 
_0 0 18_ 


r 1 

1 

1 “1 

1 V2 

V6 

Vi 

1 1 

_ I 

1 

i V2 

1 

V6 

Vi 

1 

2 

I 

L® 

V6 

V3J 


is the required diagonal matrix. 

So the equation of the quadric referred to its axes is 
6x* - 12/ + 18z^ = 36 , 



This is a hyperboloid of one sheet. 

We shall conclude this article with another example where the matrix 
does not possess distinct eigenvalues. Though we have not developed the 
necessary theory for this, the following example will show that a reduction 
to diagonal form is possible even in such a case. 


Example 7 S Reduce the matrix 


A = 


1 2 
2 1 
2 2 


- 2 * 

2 

1 . 


to the diagonal form, and hence reduce the quadric 

jc® + / + z* h — 4zx + 4xy — 27 (2) 

to its principal axes. 

The eigenvalues of the matrix A are 3, 3, and - 3. Note that in this 
case 3 is a repeated eigenvalue. So Theorem 7.4.3, which depends on 
the fact that the matrix has distinct eigenvalues, cannot be applied. How* 
ever, an orthogonal matrix can be obtained by looking at the eigenvectors 
corresponding to 3 and —3. 

The eigenvectors corresponding to the eigenvalue 3 are given by 


--2 

2 

-21 r*n 

f f 


ro- 

2 

-2 

2 

1 

1 ' 


0 

L-2 

Z 

- 2 J 

1 

LzJ 


UOJ 
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This gives only one equafion ; 

x — j' + z = Og 

The solution set of this is the subspace {(y ~ z, y, z) I y, z €. Jl) of F,. 
We can choose two linearly independent vectors in this 2-dinien8ional 
space by giving suitable values to y and z. Taking y = 1 and 2 » ], we 
get (0, 1, 1); and taking y ^ 1 and z — 2, we get (- 1, 1, 2). Since 
these two are u, we have only to orthogonalise them. Using the Gram- 
Schmidt process, we get two orthogonal vectors 

(0,1,1) and (-1, -1/2, 1/2). 

Normalising them, we get 

(0. 1/V2, IIV2) and -l/Vfi. IIV6) . 

The third eigenvector is the one that corresponds to the eigenvalue —3 
and is (1, —1, 1). 

Normalising this vector, we get (1/^/3, -1/V3, 1/^3). Without 
checking, we can say that this will be orthogonal to the two eigenvectors 
corresponding to 3, because eigenvectors corresponding to distinct eigen* 
values are orthogonal. Thus, we have the orthogonal matrix 


Hence, H^AH 
0 


I 1 n 


-V? __L 

V3 Vi 

L V'3 V- 



0 

V2 

1 n 



V3 

V3 


1 

1 

1 

V2 

V6 

V3 


1 

j_ 

1 

LV2 

V6 

V3J 

2 


r 1 2 

-2“ 

6 


2 1 

2 



L-2 2 

1_ 

3J 

r 

■3 0 

on 


0 - 

V2 

_L 
LV2 


2^ 

V3 

v6 

_1_ 

V6 


1 ' 

V3 

_1^ 

'V3 

1 

Vi. 


0 3 


_o 0 

Thus, the quadric (2) reduces to 

3je* + 3y* - 32* 


0 

-3j 


27, 
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It may be noted here that Equation (2) can be written as 


1 

~ 1 2 -21 

1 



1 

2 1 2 1 

1 

1 ^ 


L-2 2 1_ 


L2_ 


Problem Set 7.4 

1. Reduce the following matrices to diagonal form : 



“5 

1 

n 


- 6 

4 



“4 

3 3n 

1 

(a) 

1 

5 

-1 

(b) 

4 

12 

-4 

(c) 

3 

0 -1 


_1 

-1 

5J 

1 

L--2 

-4 

13_ 


L3 

-1 3^ 


2. Reduce the following conics to their principal axes : 

(a) 7x* + ilxy - ^1y* == 180 

(b) 17jr* + 312^:;'+ 108;i* = 900 

(c) 145x* + mxy + 180/ = 900. 



Appendix 


Ordinary Linear 
Differential Equations 


la § 4.9 we saw that the general solution of the R*th order normal 
linear differential equation 

^ ^ 

is of the form y = j’o + ^'p, where ye is the solution of the associated 
homogeneous equation 

a-W -i ••• + a„{x)y = 0 , (2) 

and>^p is one particular solution of (1). » is called the complementary 
function and is the kernel of the linear differential operator 

L == floCr) + ai(x) + ... ^ an(x ) . (3) 

Thus, the method of solving Equation (I) involves two steps, namely, 
finding yc and yp. Further, it may be noted that the solution space of 
Equation (2) is n-dimensional (cf Theorem 4.9.3). 

The solution of the first order normal linear differential equation has 
thus been completely discussed in § 4.9. In this appendix we shall develop 
methods of finding ye and Vp for differential equations of arbitrary order. 

Al HOMOGENEOUS LINEAR DIFFERENTIAL 
EQUATIONS WITH CONSTANT COEFFICIENTS 

In this article we shall discuss the method of finding ye for linear 
differential equations with constant coefficients, i.e. the method of solving 

* The Zero on the right-hand side of Equation (2) should he 0. But throughout the 
appendix we thall use 0 as is the practice in writing a differontial equation. Thg 
context will make it clear whether it is 0 or d. 
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homogeneous linear differential equations with cons tant xo 

start with| let us consider the second order differential equation 

«•)’' + nO'' + ao' “ 0 , (4) 

where o^, Oi, and a% are constants, and ^ 0. This equation may also be 
written as 

(a,2)* + aj> + a^y = 0 (5) 

or 

= 0 , (6) 

where L = + fli is m linear operator from to ^(/). 

It may be noted that I. is a linear operator also from to 

In § 4.9 we saw that the equation 


f P(x)y - Q{x) 

has the complementary function j'o = . When P(x) is a constant 

p, this reduces to yc = Ce**. Thus, the first order homogeneous linear 
differential equation 


has the solution Ce**, Using this as an analogy, we try e*' (where m is a 
constant) as a solution of the second order homogeneous linear differential 
equation 

(ajD® + aiD + at)y = 0 , 

This gives 


(ajn* + a,>n -I- AjIc"' — 0 . 


But €"•“ IS never zero. So 

4- 02 ^ 0 . (7) 

Equation (7) is called the indicial equation or the auxiliary equation. The 
values of m for which Equation (7) holds will lead to solutions e”” of the 
differential equation (S). Let the roots of Equation (7) be and nit. 
Then e*** and are two solutions. Their Wronskian is 










The different roots of the auxiliary equation (7) give rise to the f<rf)ow« 
ing three cases. 


Case / m, # m* In this case the Wronskian is never zero (cf Theorem 
4.9.2). So and are two linearly independent solutions of 
Equation (5). The solution space has dimension 2. Therefore, and 
e”^ form a basis for the solution space. Hence, the generd solutiem is 
ye + C,e"^ • 
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C8»2 mi mm,. 2tt this case it follows from Bqutioa (1) flat 

2mi m —aja, and one solution of Equation (3) is j'lm 
m, m "-aJTa,. Let y, be tbe other solution such that and are ii. Then 

= Ce"^2* = , 

oy AbeFs fonnula (cf Remark 6.9.4). This, on simplification, gives 

Hence, y' — j«iy, ^ Ce"^ . 

Solving this first order linear differential equation, we obtain a paitU 
colar solution y, Cxe'"^ . This gives us y, « xe"**^ as a second 
solution (taking C 1) of Equation (5). Obviously, yi » e"^ and 
y, » xe"^ are u. (Why 7) Hence, the general solution is 

ye = Ae"'^ + C,x e*^ . 

Thus, we have obtained ye. 

Example A.l Obtain y«, the complementary function for the differential 
equation 

(/)• — 2i) — l)y — sm X . 

The auxiliary equatbn of the associated homogeneous equation is 

m* — 2m — 1 ■■ 0 . 

lU foots ate nii = I 4- V2. 1 “ V2. So «*‘''’''^^*and 

are two linearly independent solutions of the associated homogeneous 
equation. Hence, 

yo «= . 

Example A.2 Consider the differential equation 

(4Z>* + 12D + 9)y >= xe-**/* . 

The auxiliary equation of the associated homogeneous equation is 

4iii* + 12m + 9 = 0. 

Its roots ate ifii = ~3/2 = m,. As the roots are equal, the two lineariy 
independent solutions are e~**<' and xe-'*'*. Ihus, the complementary 
ftinctionis 

y« “ + C,xr*^ . 

Eypnvie AJ Consider the differential equation 

(Z)» - 4D + I3)y = X* + cos 2x . 

The auxiliary equation of the associated homogeneous equation is 

m* — 4m + 13 ■» 0 . 

Its roots ate nh — 2 + 3/, itti = 2 — 3/. Since m| iri, two linearly 
independent solutions are and «**-****. Thus, tbe complementary 
fbnetionis 


• y, . Cjc*****- + Cee^»~mm . 
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Thb it a eoivlti solution. We thall now diicau the of 

teel tottttiont from complex tolutiont. 

Al.l lAmmn If ti(x) -!■ fr(x) ts a complex sotution of a homogeneous 
Unear d^eremlal equation ly » 0 with real coefficients, then both 
ti(x) and v(x) separately satirfy the equation Ly >= 0. 

Proof : Since i«(x) + Hx) is a solution of Ly » 0, we have 

JW«(x) + iKx)) = 0. 

I> it a linear operator. TheRfore, 

L(«(x)) + turn) - 0 . 

Equating the real and imaginary parts, we get 

Ufdx)) = 0 and Uy{x)) = 0 . 

Hence the lemma. | 

Case 3 Auxiliary equation with complex roots If a + /p is a root of the 
anxiliaiy equation (with real coefficients), then a — is another root. 

Since ^ m,, two lineariy independent solutions are and 

These are complex solutions. As 

e(*+'«* = e**cospx + te“sinpx 

is a solution o&the differential equation (S), it follows from Lemma Al.l 
that «** COS and e** sin ^ arc two real solutions of Equation (5). 
Further, tfa^ are linearly independent, because 

cos fix, e“* sin M Pe** 

is never zero. Hence, the complementary function can also be written at 
yo <*= cos p* + C<e** sin px . 

If Cl and C, are taken to be real, then we get all real solutions of 
Eqw tin n (S). For instance, in Example A.3 the real complementary 
function is 

ye = e*^Ci cos 3x + C, sin 3x) . 

We now state (without proof) the extension of the aforesaid method of 
Pnitinj ye for differential equations of arbitrary order. Consider the n-th 
order linear differential equation 

(qJD^ + OflP"^ *1" "i* Un-il^ "I" ®ii)x * d » (8) 

where 0 e, «i, •••. «• tre real constants. In this case also wo try y 
as a solution of Equation (8) and obtain the auxiluwy equation 

o*w" + aiHf^ + ••• + On-im + o, -» 0 . • (9) 

Th» has n roots (which may be complex). Some of the roots may be 
repeated. 

Foe eadt real root a with mutti^ity r (i.e. repeated r times) (ff the 
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MuxiUuy equation, tlie coirespondiogpart of the cofflplementaiy function is 

+ ... + , 

where i4r-i aje arbitrary constants. 

For each pair of complex roots a ± ffi with multiplicity r, the corres* 
ponding part of the complementary function is 

+ AiX + ... + Ar-iX^^) cos px 
+ c*'(Jo + + ... + sin px . 

Let us illustrate these rules through a few examples. 

Example A. 4 Find the complementary function of the diffetential 

equation 

y"> + / = 2x* + 4 sin X . 

The auxiliary equation is m* + m — 0. Its roots are m = 0, i, —I. So 
the complementary function is 

yc — Cl + Ci cos X -f C, sin x . 

Example A.5 Consider the differential equation 

(D* - 10i)‘ + 430* - 1000» + 1310* - 900 + 25)y = x» . 

The auxiliary equation is 

m* - 10m* + 43m* - 100m* + 131m* - 90m + 25 = 0 
or (m — l)*(m* — 4m 4- 5)* = 0 . 

Its roots are mj = m, = 1; m, = m 4 = 2 + i; m, = m, = 2 — /, 

Corresponding to the repeated root *1’, the complementary function is 

e-(Q + C,x) , 

and corresponding to the repeated complex roots, the complementary 
function is 

e*“{(Ca f Cix) cos X + (C, + C,x) sin x} . 

Hence, the complementary function is 

ye = •’•(Q + C,x) + <r**{(C* + C*x) cos X + (C, + C,x) sin x} . 

Problem Set A1 

1. Solve the following homogeneous linear differential equations : 

(a) y + 4y' + 4y = 0 (b) y" + 4y = 0 

(c) /" + / = 0 (d) 3y"+/-2y = 0 

(e) /"-y=--0 (f) /'-2/-3j;*0 

(g) y" + 2/-y = 0 (h) +j; = 0 

(0 (D* + 4D» -- 5Z)*)y = 0 (j) {IP - IP - 6D)y =» 0 

(k) (f)* + 4D + ll)*y = 0 (1) (Z)»-1)*;' = 0 

(m) (IP - 3D + 2)*y = 0 (n) (IP + 3D + l)y - 0 

(o) (2IP + 5J>* - 3D)y = 0 (p) (IP - 4IP + AD)y - 0. 
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A2 METHOD OF VARIATION OF PARAMETERS 

In this and the next two articles we shall give various methods of 
finding >’p for a nonhomogeneous ordinary linear differential equation. 
One method universally applicable to all linear equations (even to some 
nonlinear equations) is the method of variation of parameters. 

We shall illustrate the method by taking a second order equation 

+ a^y = g(x), a, ^0. (I) 

Let the complementary function ye be 

yo = + Ciy,(jc) , 

where Q and C, are arbitrary constants, ard yiix) and >’i(x) are two 
linearly independent solutions of the associated homogeneous equation of 
Equation (1). In this method we assume the particular solution >'p to be 
of the form 

yp(x) = Uiix)yiix) + , ( 2 ) 

where Ui{x) and H|(jc). yet to be chosen, are twice differential functions of 
X. Our assumption will be justified if we can show that Ui(x) and m^(x) 
can be chosen such that (2) is a solution of Equation (1). Since we have 
to determine two functions Ui(x) and »«(x), we will have to specify two 
conditions. Obviously, one of these is that yp satisfies Equation (1). 
The other is to be chosen so as to fadlitate the calculations. Differenti* 
ating Equation (2) with respect to x, we get 

yp(x) = «x(x)y,(x) + «*(x)yi(x) + . 

In order to simplify the calculations, we shall impose the condition 

= 0 • ( 3 ) 

This implies 

y'vix) = Hi(x)y;(x) + i/,(x)y;(x) . 

So y^ix) = ui(x)yl(x) + «,(x)/(x) + Mi(x)y,'(x) + «,'(x)y;(x) . 

Substituting yp(x), y^fx), and yj(x) in Equation (1), we get 

+ ^l + "tyi + + “*3's) + M«iyi + 

=» 8(*) • (4) 

Since yi and yt are solutions of the associated homogeneous equation of 
(I), we get 

+ oiyj + «»yi = 0 and o^yj + ajy,' + «iy* - 0 . 

So Equation (4) becomes 

«o(w>i + ‘W’t) “ «(*) 

+ uiyi “ g(x)/a« . ( 5 ) 

Equatioiu (3) and (S) give two conditions governing t' e choice of u, and 
If we can choose Ut and so as to satisfy these two conditions, then 
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we are through. Writing these together, we hava 
ui(x)yi(x) + u,(x)y,(x) » 0 
«^(x)yj(x) + u^(ix)y,{x) » g(x)/a, . 
Solving for ii,(x) and i/^(x) by Cramp’s rule, we have 


and 


«iW 


0 y^x) 

g(x)lat yijx) 
j'liJt) y»(x) 
ly;u) /tix) 


y«(*)g(*) 
a^lViyiix), y,(*)J 


yi(x) 0 j 

= -ViW g(x)laJi _ yi(x)g(x) 

’ . yi{x) y,(x)( a,»'ly,(x),y,(x)J * 

yi(x) yi(x) 


Carrying out the integrations, we get 




tx g't)ytO)dt 

* ao*yiyi(t),yt(n] 


( 6 ) 


(7) 


Mx) = r 


g(t)yiU)dt 


ThuSg a particular solution of Equation (1) is 

g(t)yt(t)dt . 


ypix) = 




ytix) 


git)yi(t)dt 


tx yitJcWO — yi(x)y,(r) 


sm . 


(8) 


Hence, the complete solution of Equation (1) is 


yi 


Ciyiix) + C»y,(x) + f* 


y^x)yi(t) — yi(x)y,(f) 

o,W[y^{t),yM] 


git)dt. 


A2.1 Remark The same- method is applicable to equations of arbitrary 
order. The only modification is that in the case of the n*th order 

equation we shall need n arbitrary functions Ui(x), tq(x) ujpt) in 

yp, since there are a arbitrary constants Q, Ct, ..., C» in the comple* 
mentary function. We riiall impose on it (n — 1) conditions, one at 
each successive differentiation, in addition to the first condition that 
y» + **»yt + ••• + tvy. satisfies the nonhomogeneous differ- 

ential equation. 

Instead of carryiny out these details in the general case, we shall 
illustrate the meth^ by working out some suitable examides. 

Exan^te AjS (D* — 2D — l)y *■ sin *. 

The complementary function is (cf Example A.1) 
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So we 

We can now obtain «i(jc) and tij^x) by going through the process already 
described. Since we have done this for the general equation of the second 
order, we shall merely plug in the functions in Equation (8). We have 

Wlyiix),y^ix)] - = - 2 V 2 «^ . 

Hence 

^(l-V2)x ^(l+V2)t _ ^(t-V2)l ^(l+V2)x 


yv(x) •= J* 


sintdt 


-2V2e** 

jx [^(i+V2)x ^-(V2+l)/ _ ^a-V2)x ^(V2-l)/j 


^ (sin jr — cos *) . 

A2.2 Remark The reader is advised not to use result (8) for finding yp. 
He should carry out all the steps needed to arrive at Equation (8) as 
illustrated again in Example A.7. 

Example A 7 ^ ” 2x* + 4 sin x. 

The complementary function is (rf Example A 4) 

= Cl -h Ct cos X + C, sin X . 

So we assume 

yp(x) = «,(x) + «,(x) cos X + u,(x) sin x . 

Then 

yp(jf) = “i(*) + cos X + «i(x) sin X — ii»(x) sin x + «t(x) cos x . 

When we impose the condition 

u^(x) + i4(Jif) cos X + w,(x) sin X = 0 , (9) 

we get 

yp(x) = —«*(*) sin x + «j(x) cos x . 

Differentiating again, we get 

y^x) = -«i(x) cos X -n,(x) sin X - i^(x) sin x + «,(*) cos x . 

We now impose another condition 

— «i'(x) sin X + «i(x) cos X s: 0 . (10) 

So — -«i(*) cos X - «,(x) sin x 

and y'pXx) ■= -i4(x) cos x - « (x) sin x + «k(x) sin x - «,(x) cos x . 
The third condition on «i(x), «,(x), n,(x) is that yp should satisfy the 
equation 

y'" 2xS + 4 sin X . 

Substituting yp, we obtain 

-iq(x) cos X - «i(x) sin X =* 2x* + 4 sin X . (11) 
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Writing Equations (9), (10), and (1 1) together, we get 

«i(-v) + «*(Jc) cos X -+ tt'(jc) sin jc = 0 

— sin X f u^(x) cos x =■ 0 

— i/'(x) cos X — u^(x) sin x — 2x* + 4 sin x . 

Solving by Cramer's rule, we obtain 

«i(x) = 2x* ^ 4 'in X, Mj(x) — — (2x* 4 4 sin x) cos x 
and «s(x) — (2r^ 4- 4 sm x) sin x . 

This, on integration, gives 
lx' 

Ui(x) = 3 - 4 cos X (12) 

“sW -- ~2 sin* X — 2x‘ sin x - 4x cos x 4- 4 sin x (13) 

and 

« 3 (x) == 2x* cos X — 4x s n X — 4 cos x — 2x 4- sin 2x . (14) 

Thus yp(jc) ~ 3 ~ ^ “*W sin x 

-= 2 - 4 cos X — 4jir — lx sin x . 

Hence, the complete solution is 

2jc* 

y — Cl + Ci cos X 4- Ca sin X 4 4x — 4 cos x — 2x sin x 

2 

= Cj 4- -D* cos X 4- C, sin x 4- -y x® — 4x — 2x sin x . 

Note that in this example we needed three conditions, because the 
differential equation involved is of order 3. 

Problem Set A2 


1 . 


2 . 


Using the method of variation of parameters, find the general solution 
for the following differential equations : 


(a) (D* 4- 4 ) 3 ; = X sin 2x 
(c) (D* 4- 4)y = sec 2x, 

0 < X < k/4 

(e) (4D* 4 - l)y — sec* x/2, 

0 < X < It 

(g) (D* 4 - 4D 4 - 4 ) 3 - = xe-** 
(i) (JP + D)y=^x* 

(k) - 3/' -y’ + 3y = c' 


(b) (Z)* - 4D + 4)y = xe-** 
(d) (3D® 4- Z> - 2)y = 3«- 

(0 (D*4- I)y = 8inx 

(h) (6D* 4- D - 2)y = xe- 
(j) (D* — D)y « X cos X 
(I) 2/" 4- /' - / = «•'*. 


Let yi(x), 3 't(x), •••,>'h(x) be n linearly independent solutions of the 
associated homogeneous equation of 

(o,D* 4- OiD^* 4- ... 4- <i,)y = g(x) . 
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Use the method of variation of parameters to prove that 
ytix) * I* Kix, 0-*^^ dt, where 


K(x, t) = 


1 


ri(0 

ytit) 

••• yn(0 

y'xit) 

>’s(0 

- y:io 



- >’»<"-*>(0 


ytix) 

— 3'n(*) 


A3 METHOD OF UNDETERMINED COEFFICIENTS 

The method of undetermined coefficients is applicable whenever the 
right-hand member g(x) of the nonhomogeneous n-th order linear diflFer- 
ential equation with constant coefficients 

-1- ... 4 fluV =- g(x) (1) 

is a finite linear conibination of 

(i) powers of x; 

(ii) sin *x, cos «x; 

(iii) e**; and 

(iv) finite products of any of the functions in (i), (ii), and (iii). 

In order to outline this method, we need the following definition. 

A3.1 Definition Given a function /(x), a set of those linearly independent 
functions whose finite linear combinations give the function /and all 
its derivatives is called a derivative Jamilv of f{x). It is denoted by 

m- 

Example A. 8 Here we list the derivative families of four functions : 

(a) Dlx^] =» {*“. , x®, X, 1} 

(b) D[e^]^{e^} 

(c) D[sin «xl - {sin ax, cos ax} 

(d) D[cos pxl = (cos Px, sin pr}. 

We shall be interested in only those functions / for which D[f] is a 
finite set; for example, the functions listed in Example A.8 and their 
finite products, namely, x“, sin ox, cos ax, x« sin ax, x« cos ox, 
x“e**, e** sin Px, e" cos px, x-'e*' sin px, and x*c** cos px. 

For each of these functions, a derivative family can be obtained as 
illustrated in Example A.9. 

Example AS Die" cos px] = {/[x)g(x) |/(x) £ Z)[e«*]. g(x) £ D [cos px}} 

= {«**' cos px, sin Px} . 
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!)[*• sin «cl =« {fix^x) [fix) € Dipi*]* fix) € />(8in ox]} 
a {x<* sin ox, sin «ex, •••, xsin ouc, sin ouk, 
X** cos ax, x**~* cos ax, x cos ax, cos ox} . 
sin M * {/(x)^x)A(x) | fix) G 

«<x) € 2>I«^, Mx) € />l8in px]} . 

A3.2 Remark It can be easily verified that for two functions p(x) and 
«(jc) 

I3{pix) + j(x)l = D\pix)\ U D{(^x)\ . 

Now we are ready to enunciate the method of undetermined coeffi- 
cients for finding the particular integral yp of 

{apD* + + ••• + = gix) . 

Step 1 Write 

six) = gi(x) + g,(x) + ... + g,(x) , 
where each g<(x) is a function of the type mentioned immediatdy after 
Example A.8. 

Step 2 Find the derivative family Z)[g<] for each / = 1, 2, ..., k. 

Step 3 Find the complementary function ye of the differential equation 
in question. Let 

yc - CiPiix) + C,y,(x) + ... + CnPnix) . 

For each i = 1 k, check whether any member of D[gii is already 

one of the y/s, i.e. a solution of the associated homogeneous equation. 
If so, then multiply each member of />[g<], for that /, by the least power of 
X such that the new set thus obtained does not contain any y^ Call this 
new set the modified filgi]. 

If no member of i>[g,l is a y^, i^en leave that 0[g,] unchanged. 

5/ep 4 Let be the union of all those D\gtYs that have not been 
modified and all the modified DteJ’s. 

Step 5 Assume 

yp = 2 AMx) , 

where the At a are arbitrary constants, and A«(x) varies through all the 
members of 5[g]. In other words, yp is a linear combination of all mem- 
bers of S[gl. 

Step 6 Substitute yp in tbe differential equation and determine the coeffi- 
cients At a by equating coefficients of identical terms on both sides. 

We Olttstrate this method through the following examples. 

Example A.IO (D* — 2i) — l)y — sin x. 

Tbe complementary function is (cf Example A.l) 
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To get ypt we proceed as follows : 

St^ i It b not necessary here. 

Step 2 X)[sin x\ « (sin x, cos x}. 

Step 3 No modification of i>[Bin x] b needed, because neither sin x nor 
cos X occurs in the complementary ftnction. 

Step 4 iS[sm x] => (sin x, cos x). 

Step 5 Assume y^x) = sin x + cos x. 

Step 6 yj,(x) cos x — .9 sin x, 

>’p(*) sin X - B cos x. 

Substitution in the equation gives 

(2^ — 2^1) sin X — {2A + 29) cos x =» sin x . 

Therefore, 2A + 2B = 0 and 2B — 2A = I. This gives A =» —B 
*■ — 1/4. Hence, yp(x) = (cos x — sin x)/4. Thus, the complete solution 
b 

y » - (sin X - cos x)/4 . 

Exan^k A.II (4Z)* + \2D + 9)y = xe-*"/*. The complementary fimc- 
tion is (rf Exampte A.2) 

y^ = . 

St^ I It b not necessary here. 

Step 2 i)(xe-*-/*l - {xe-^/», e-^/*). 

Step 3 Both the functions in the set J)[xe-**'1 appear in the comple* 
mentary function. So we multiply them by x*. (Note that multiplication 
by X wQl leave one fhoction in the set to coincide with one in the comple* 
mentary function.) So the modified derivative family u (x^e***/*, x*€^/*}. 

Snsp 4 Slxr^/l = {**«*^'*. x*e-*"'*}. 

5 Assume yp «*» vix’e-**'* + Bx*e^’^. 


Step 6 y'-r-«-«(— ^x» + 3^x«- ^x* + 29x) 

y' -e-*»/*(^x*-'~x* + -~x»-3Jx---y X* 

4 2 4 2 

+ 6^x - 39x + 29) . 

Substitution in the equation gives 

e-^P(2AAx + 89) = xe-*»^ . 

Henoet 9 » 0 and i4 *• 1/24. Thufc, yp(x) =« (x*/24)e-*'* and the 
complete solution b 

y^iCi + C^ + x»/24)e-»'* . 


Exanpk AJ2 (D* — 4£> + ISJy — x* + cos 2x. The complementaiy 
fbiMlion(feal) b (cf Eiample AJ) 
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=» e**(Ci cos 3x + C| sin ix) . 

Step I g(x) = X* + cos 2* = ft(x) + ft(x), 
where gi(x) — x*. g,(x) = cos 2x. 

Step 2 D[gJ = {x*. X, 1}, D[gtl = {cos 2x, sin 2x}. 

Step 3 No modification of the derivative families is needed. 

Step 4 5tg] = {x*, X, 1, sin 2x, cos 2x}. 

Step 5 Assume >'p(x) = i4x* f ^Bx + C + /> sin 2x + £ cos 2x. 

Step 6 Substitution of yp in the equation gives (2A — 4B + 13C) 
+ {-9A + 13£)x + 13.4X* + (13£ - 8D - 4E) cos 2x + (13D + 8£ 
— 4D) sin 2x = X* + cos 2x. 

This gives A = 1/13, B = 8/169, C = 6/2197, D =- -8/145, E = 9/145. 
Hence, 

X* . 8x , 6 9 cos 2x - 8 sin 2x 

13 169 2197 ^ 145 

> 

and the complete solution is 

y = e*®(Ci cos 3x + C, sin 3x) -t . 

Example A. 13 (D* + D)y = x® -f 2e* sin x. 

The complementary function is 

cos X + C, sin X (cf. Example A.4). 

Step 1 g(x) = gi(x) + g*(x), where gi(x) =» x*, g,(x) = 2e® sin x. 

Step 2 2)[g,] — {x®, X, I}, D[gj] = {e® sin x, c* cos x>. 

Step 3 Since ‘1* is included in the complementary function, i>[x®] is 
modified as (x®, x®, x}. 

Step 4 S[g] = {x®, x®, X, e* sin x, e* cos x}. 

Step 5 Assume >’p — ^x* f JJx* f Cx + Dt“ sin x 4 £e* cos x. 

Step 6 Substituting j'p m the equation, we get 

6y4 + 3.4x® + 2£x + C - (Z) + 3£)e* sin x + (32) - £)e* cos x 

= X® + 2e* sm x . 

Thus, A = 1/3, £ = 0, C = -2, D = -1/5, £ = -3/5. 

Hence, 

jc* 1 3 

>'p = -^1 2x j-e* sin x j-c* cos x , 

and the general solution is 

^ = C, + C, cos X + C,sinx + - 2x - . 
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Problem Sftt A3 

1. Using the method of undetermined coefficients, find the general 
solution for the following differential equations : 

(a) y- -2y' -iy^^ (b) y" ^y = sin 2 jc 

■ (c) y + 2y' + = jce* f X* (d) (i)* + 2i) - l)y - 2cosh* 

(e) (/)* — D* — i) + 1);' = sin * + 1 + jrc * 

(0 iD* + 9D)y=^x 

(g) (-0* + Z)’ —D — l)j> = ;t sinh .x + jc* -|- 3 

(h) (/)• + D)y = 2 cos 

(i) (D* + 4Z)* - 52)*)y = x + x sin a: 

G) y"' ~ y’ — 6y' = xe-** + sin X + jc -f er^ 

(k) (D* + 4Z) + 1 1)3> = jcc'** + c"®* sin 3 a. 

A4 OPERATIONAL METHODS 


The two methods discussed in § A2 and A3, namely, the method of 
variation of parameters and the method of undetermined coefficients, 
suffice to take care of all problems of finding a particular solution. How* 
ever, in this article we add to the reader’s armour another tool, which 
often comes in very useful : Consider the equation 

f(P)y = g(A) , (1) 

where f(D) = <7oZJ" f Oii)"-® + ... + On-iD + On, and Oo, «i, .... are 
constants. To obtain one particular solution of this equation, we are 
tempted to write formally 

y = six ) . (2) 

This is only a formal step, which would be useful only if it enables us to 
calculate j/. First, we have to give a meaning to Equation (2), Second, 
we have to relate Equation (2) to Equation (!)• We achieve both purposes 
simultaneously by defining Equation (2) as follows. 


A4.1 Definition If /(D) = aoD^ + + ... + a«, where ..., a, 

are constants, then 

is defined as a function y for which /(Z))y = g(x). 

This definition gives meaning to Equation (2) and also relates it to 
Equation (1). 


We sh^l now show that 


m 


g(x) can indeed be calculated easily in 


certain favourable situations. 
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The simplest case occurs v hen f{D) ®= D. Now gipc) is that func- 
tion y for which Dy » g(x). This means 

So ^ Bx J g{x)dx. Since we are interested :n only one particular solutidn, 
we shall ignore the arbitrary constant. Thus, we have 

g(x) = f g(x)dx . (3) 

Extending this we see that 

gix) = S a g(x)dx)dx , (4) 

and so on 

We now take the case /{D) =/) — «. Then jr- — g(x) is evaluated 
as follows : Let 



Then (D — a)y = g(x), which is a linear differential equation. So 
y — e*” i e-«*g(x)<ix (cf § 4 9). 

Thus, we have 

£, i, ^ g(x) = e** / e-**g(x)<fot . (5) 

Example A. 14 Calculate «“* sin px. Using Equation (5), we get 

v*’’ sir. 3x == e*® J e-a»e“* sin Px dx 
«** cos Px 

f~ ' 

To handle more complicated expressions for /(/>), we first note the 
following result. 

44 2 Theorem The set of all operator polynomials f{D) = a^D* + 

4- . . + fl»/, where a,, o„ .... are in general con^lex constants, is 
a vector space (real or complex, according to the scalars used) Here 
I is the identity operator. 

The proof is left to the reader. Note that each such/i[/)) is itself a 
linear operator on 

If /{D) and g(Z>) are operator polynomials, then f{D) o g(P) or 
simply f[D)g(D) is defined, just as we defined jSoTin Chapter 1, i.e, 
iAD)g(D))y = f(D)(g{Dfy). This multiplieatjon is 
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(a) associative, i.e 

nmigimo)) = , 

(b) tUsiribuUve over addition, i.e. 

ADXm + k{D)) ^AD)g{D) +Am(D) 
and (AD) + g{D))h(D) = Am{D) + giD)k{D) , 

(c) commutative, i.e. 

AD)g{D) g{D)AD) . 

A4.3 Remark It may be noted that the multiplication of operator poly- 
nomials is not commutative if the coefficients are functions of x. 
For example, 

{xD + I)D = xi)« + D but D(xD + /) = xD* + 2D . 

Because of the aforesaid properties, we may use the results of ordinary 
algebra pertaining to factorisation of polynomials. Note that D — I can 
be written as D — 1 without any damage to the working. In gmieral, 

(D) « + ajy^^ + ... + «»/ 

can be written as 

AD) = . 

as we have been doing all along. In particular, we can factorise 
D* - 5D -1- 6 as (D - 2)(Z) - 3). 

With this background, let us now handle g(x) . We illustrate 
the method through the following example. 

Example A.15 Evaluate sin x. 


We write 



= ^ (r-* Jc* sin x dx) 

= ^ e* J (s™ * “ 

A 

=r — y sin X . 


(by (5)) 

(by (5)) 


To solve such problems we can also use partial fractions as follows : 


1 


sinx 


1 


: Sin X 


(2)-lKI>+ 1) 

— ( — ^ “t) Of 

2 'D - t D -I- 1' 
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_ J_ 1 

2 “ D - 1 

= ^ s' J e-* 
This, on simplification, gives 


sin X — 


1 I 

2 D+ 1 

sin jc<£c — J 


sin X 

sin xdx . 


I 


1 . 
sin AT. 


Actually, there should be two arbitrary constants, but we omit them since 
we are interested in only a particular integial. 

In such operator methods the foIloM ing theorem is useful. 

A4.4 Theorem Jff(D) is the operator polynomial + ... + 

with constant coefficients, then 

(a) /(/»«-•= yi[a)c«*. 

(b) Amie^gix)) = c«'/(^ + a)gix). 

(c) /(/)*) sin OLX =•= /( —a*) sin »x. 

(d) cos oix =■ /(—a*) cos aJt. 

The proof of this theorem is left to the reader. Using Theorem A4.4 
and Definition A4.1, the next theorem immediately follows. 


A4.5 Theorem Let f(D) = a^jy* + aiD"-^ + ... + a« 
polynomial with constant coefficients. Then 

w m " '"yfoTio 

(c) sin <xx = sin aJt, /!;-«*) # o. 

(d) cos dX = -77:^ cos ax, /(-«*) 0. 




be an operator 


(e) ^ {Fix) + e(x)) = ^ P(x) + ^ Q{x). 

With this theorem, let us find particular integrals yp for the differential 
equations in the following example, some of which we have already 
worked out by earlier methods. 


Example A. 16 Consider the differential equations 

(a) (IF -2D - l)y = sin * 

(b) (4D* + 122) + 9)y = 

(c) (IF-AD + 13)y - j«» + cos 2* 



(d) (D* + D)y = 2x* + 4 sin X 
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(a) yv “ s*“ * 

+ 2Z) - I 

” (JD* - 1)» -“45^ * 

— ~Y + 2D — 1) sin X (by Theorem A4.5) 

= (cos X — sin x) . 

It may be noted that, as a working rule, we can use also the following 
method : 

y^^iy-L-i 

~ — 1 ^ writing —1 for D*) 

1 1 

r-D+-i«“^ 

_ sin X = -i(D - 1) 

= i{D — 1) sin jc (by Theorem A4.5) 

= — i(sin JC — cos *) . 

Note that in this method we replaced D* by — 1. In general, to 
evaluate sin ax or cos ax, we replace D* by —a* iu f(D) pro 
vided (D* + 0 *) is not a factor of /(D). 

y^ “= 4D* + 12D + 9 **"**'* “ (2D + 3f ^*'**'* 

_ * JC (by Theorem A4.5) 

4lr 

_ JC»«-*»/* 

24“* 

“ /)* -4D+ 13 ** D* - 4D + 13 ^ * 

Taking the second part, we have 

1 - I 
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9 + 4D 
81 - 16J>* 


cos 2 x 


_ (9 + 4/))(gj _ cos 2x) 


(9 + AD) ^ 9 cos 2x — 8 sin 2jc 

j^cos 2 x . 

To tackle the first part, we have no operational method so far. But 
the following ‘formar method, for which we cannot give any justification 
within the scope of this appendix, is successful : 

_ J n - I I 

13 ^ 13 169 

(by a formal long division) 
13 13 ^ 169 ^ 


Hence, 


_L_ (jc* ^ -IfL -L 
13 ^ ^ 13 ^ 169 ^’ 


jc* , 8 x , 6 , 9 cos 2jf — 8 sin 2x 

13 J69 2197 145 


A4.6 Remark The working of ji' i. 13 though not justifiable 

at this stage, can be very powerful. The reader is urged to use it 
with the full knowledge that he is using only a formal method, the 
validity of which is beyond the scope of this appendix. 

In any case the reader will have already noted that wherever the 
operational method can be used it is really powerful. 

(d) yp = nsi h * + 2 **) 


‘^Px +^p.- 


D* D 
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We cannot apply Theorem A4.S. In this case we continue as follows : 

= -4 Re (#<• (2) + 0* + 1 

“ (D + 2i )D 

= _4 Re (^--^-1— X) 

e<» A> n* 

“-4R«(V 0 - I +-i;* T • -w 
= - 4 Re (<'“(— I I ~ )) 

, jc sin jc V ^ 

~ — 4(-^ cos X + ^ ) = - 2 jc sm X “ cos X . 

N“» 'p. ” ” 5^ rr 

-' 3- +"•-■••>'’ 

= -| (ac* — 6x) = - 4x . 

Thus, 

2jc* 

j’p ^ —cos jf — 2ac sin X 4 — ^ — 4x . 

It may be noted that the term ( -cos x) can be omitted in view of the 
fact that cos x is a part of ^c- 

Problem Set A4 

1. Factorise the operator in each of the following cases and hence find 
a particular integral : 

(a) {IP -\)y^e 

(b) (D* - 3f) 4- 2)j» = X 4- «*• 

(c) (D* + 4D* - SD)y =» x 4- sin x 

(d) (8/)» 4- 12IP -2D-i)y^x-\-xe*. 

2. Using operational methods, determine a particular integral for the 
following diiSerential equations : 

(a) (D* - 32F 4- 72) 4- S)^ = e-*» 

(b) (JP + 9D)y--Gos3x 

(c) (D* + 32) 4- i)y *= e“ «n 2x 
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(d) (/)» + 42));^ = S!n2* 

(c) (/)* + 3D - 4)y = e*(3x* + 5* - 7) 

(f) (D — 2)*j> = e®* cos a: 

(g) (2D» + 5D» - 3D);^ = c-*» 

(h) (D» - 4D + 4)*^ = 

3. Prove Theorem A4,2. 

4. Prove Theorem A4.4. 

5. Prove Theorem A4.5. 



Answers to Problems 


Problem Set 1.1 

4. (a) {* € J? I -1 < * < 1} (b) -1 <*<0} 

(c) {Jf e I -K .V < 2} (d) {Jt G 1 2 or Jt < -2} 

(e) {jc G A I Jc > 1 or ac < — 1} (0 

5. (a) The set of all complex numbers represented by the points inside 

a circle of radius 4 centred at the origin 

(b) The set of all complex numbers represented by the points on a 
circle of radius 4/3 centred at (- 5/3, 0) 

(c) {z G C I Im 2 < 0} 

(d) The set of all complex numbers represented by the points on a 
circle of rhdius 3 centred at (—2, 0). 

6. (a) {0}, {!}. {2}. {0. 1}. {0, 2}, {1, 2}, {0, 1, 2} 

(b) (a), (p), {T), (8), {«, p), {«, y), {a, 8), {p, y), {p, 8), {y, 8). 

{«. P, y}. {«. P. 8}, {a. y, 8}, (p, y, 8}, {a, P, y, 8}. 

7. 2". 


Problem Set 1.2 

1. (a) {0,1,2,3,4,5,6,7,8,9,10} (b) {1,2,3, 4} 

(c) {0,1, 2, 3, 4} (d) C (e) {0} (f) ^ 

(g) {JC G il I ac < 10, at ^ 0, 1, 2, 3, 4} 

(h) {(0, 1), (0, 2) (0, 10), (1, 1), (1, 2), .... (1, 10), 

(2, 1), (2. 2). ..., (2. 10), (.3, 1). (3, 2) (3. 10), 

(4.1), (4, 2) (4, 10)}. 

2. (a) {0, 1, 2, .... 20} (b) {0,1,2,3,4,7.14,21.28....} 

(c) {jc G AT i 3 < * < 20} (d) {7, 14} (e) {4} (f) ^ (g) {0} 
(h) A (i) {1,2,3} (j) {acG JV|*<20.ac#7. 14} 

(k) {at G -W I ar > 3, X not divisible by 7} 

0) {(0, 1), (0. 2) (0, 20), (1 , 1), (1 , 2) (1 , 20). 

(2, 1), (2, 2) (2, 20), (3, 1). (3, 2) (3, 20), 

(4.1), (4, 2) (4,20)}. 

4. (a) {(a, p). («, 8), («. 6), (P. p). (p, 8). (p. 6), (y, p). (y, 8), (y, 6)} 

(b) {(«, a), («, y), («, e), (P, a), (P, y), (p. e), (y, a), (y, y), (y, «)} 

(c) {(P. «). (P, y). (P. t), (8, «), (8, y), (8, c), (8. «). (0, y), (6, c)}. 

5. (a) {x I X > 7 or X < 0} (b) {x | x ,6 1} (c) R 
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(d) {xl-l<x<l)' (e) ^ (0 {xlx>l). 

Problem Set 1.3 

1. (a) Reflexive (b) None 

(c) Reflexive, symmetric, traositive, and hence an equivalence 

relation (d) Transitive (e) Reflexive and transitive 
(0 Symmetric (g) Transitive (h) Symmetric 

(i) Reflexive, symmetric, transitive, and hence an equivalence 
relation 

(j) Reflexive, symmetric, transitive, and hence an equivalence 

relation 

(k) Symmetric and transitive. 

Problem Set 1.4 

1. (b) and (c) are functions. 

2. (a) (i) Not possible (ii) f{a)^f{b)=f(c)^f{d)—\ 

(iii) Not possible (iv) /(a) = 0,/(b) — l,/(c) = 2,/(rf) = 3 

(b) (i) Not possible (ii) /(I) = =/(3) = 1 

(iii) /(I) = 0,/(2) = 2,/(3) = 3 (iv) Not possible 

(c) (i) /(O) =/(l) = l,/(2) = 2,/(3) = 3 

(ii) /(O) ==/(!) = 2, AD =/(3) = 3 

(iii) Not possible (iv) Not possible 

(d) (i) /(x) = tan X (ii) /(x) = sin x 
(iii) /(x) = e* (iv) /(x) = 3x 4 4. 

3. (a) (- 00 , -1] U [1. 00 ) (b) [-2, 2] (c) {x € R 1 x - 1} 

(d) R (e) R (0 {0}U 11,00). 

4. (a) C (b) {z € C I z # 0} (c) C (d) C (e) C (f) C. 

5. 4(a) [0, 00 ) 4(b) [0, 2] 4(c) {x € R | x vt 1} 4(d) [6, oo) 

4(e) [-1/2, 1/2] 4(f) [0. 00 ) 

5(a) {z € C 1 Im z = 0, Rez > 0) 5(b) {z £ C 1 | z | = 1} 

5(c) {z e C 1 Im z = 0} 5(d) {z € C | | z | = 1} 

5(e) {z £ C 1 Im z 0, Re z > 0} 5(0 C. 

6. (c) is one-one. None is onto. 

8. (a), (c), and (0 represent functions. 

Problem Set 1.5 
3. (a) In R define a * b — a 

(b) In R X R define (Xi, x,) * (Pi, -* ^ ^* ) 

(c) In R define a^b’^a — b + ab. 
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Problem Set 1.6 

6, Additive identity, additive inverses, and multiplicative inverses ace 
not in N. 

Problem Set 1.7 

2. gofix}-* sin* *, — 7c < X < w. /o ^ is not defined since R{g) 
^ Oif)- If 7)(g) =» (— v'«. Vw]. then/o g is defined and 

/o : X t— ► sin x*, —\/7c < x < V’’*- 

3. gof'.x V(I + **)» — 1 < Jc < 1. fog is not defined since 
R{g) if D{f). If D{g) — [0, IJ, then f oga defined and 

/o : X l-> 1 + X, 0 < X < 1. 

6. if + f)(x) = sin X + X*; (/ — g)(x) = sin x — x*; 

(/«)(*) = X* sin X. 

7. (/ -I- if)(x) = 1 + X* + (/- ^)(x) = 1 + X* - V*: 

(Mix) = (I + x*)v/x. 

10. No. 


Problem Set 2.1 

2. (a) A plane parallel to the xz-plane 

(b) A plane parallel to the xy-plane 

(c) A line passing through (1, 0, 0) and parallel to the line y » 2z 
in the ^z-plane 

(d) A parabola in the plane y =» —5; the axis of the parabola is a 
line parallel to the x-axis and passing through (0, —5, 0) 

(e) The projection of the rectangular hyperbolas yz = I and 
yz — —I (lying in the j'r-plane) on the plane through (2, 0, 0) 
parallel to the ^T-plane 

(f) The half space on that side of the ^z-plane in which x < 0, and 
the yz'plane 

(g) X = y is the plane perpendicular to the x^'-plane and containing 
the line y — x in the xy-plane; the required set of points is the 
union of the plane x ^ y and the half space on that side of this 
plane that contains the positive x-axis 

(h) The projection of the line y = 2z (lying in the yz-planel on the 
plane through (3, 0, 0) parallel to the^’z-plane along with the 
half plane determined by this projection and containing the 
point (3, 1, 0^ 

3. (a) V3 (b) V14 (c) ViO (d) 3. 

4. (1. 2, 3), (- 1, 2, 3), (-1, 1 1/2, 3), (1, 1 1/2, 3),£, 2, 9/2), 

(-1, 2, 9/2), (-1, 11/2, 9/2), (1, 11/2, 9/2); V37/V2. 
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Problem Set 2.2 


1. (a) V13; tan 0 = 3/2, 0 < 6 < it/2 

(b) yiOl 4*^“® “ 3«/2 < 6 < 2« 

(c) 3V5; tan 6 = 2, 0 < 6 < it/2 

(d) V5; tan 0 =• -2, 7c/2 < 6 < « 

(e) V2; 0 = 7t/4 (f) VI 3; tan 0 = -3/2, 37t/2 < 0 < 2ic 

(g) V^ tan 0 - 4, it/2 < 0 < It 

(h) 2V5; tan 0 - 1/2, jt < 0 < 3ft/2._ 

2. (a) V14 (b) 5 (c) V14 (d) V21. 

3. (a) (6,-9) (b) (4, -4,. 12) (c) (-33,-9) (d) (2,17,12) 

(e) 13i+18/-llft. 

4. (a) 2i t- 3i (b) -i 4/ (cl -3i - 5J (d) 5i -H 3y - 2* 

(c) 2i h k (f) -i -f- 2j. 

5. (a) — « + 2v (b) 3« — 20i» 1- 12h' (c) — b — llv -1- 7w 

(d) 3 b -H 2v — 2m' (c) 4b + 12v — Qm' (f) "2 b — 25v + 15m’. 

6. 1(a) (2/V13, 3/V13) 1(b) (3/VIO, -I/VIO)' He) (1/V5.2/V^ 
1(d) (-1/V5,2/V« i(e) (i + /)/V2 1(0 (2i - 3/)/Vl3 

1(g) (- I* + 4j)/V17 Hh) (--2»' - i)/ V5 
2(a) (2/Vl'C -1/V14^3/V14) 2(b) (3/5, 0, 4/5) 

2(c) (3i -) 2j - *)/ V14 2(d) (-1 - 2j + 4*)/V21. 

7. (a) (-1/V2, -1/V2) (b) (V3/2,l/2) (c) (1/V2, - 1/V2). 

8. (a) (1, -1,2) (b) (2,3,1) (c) (4, -2, 1) (d) (3,2,6) 

(e) (2, -4) (0 (6,2). 

9. (a) ^(1/2, 1/2), fi(3/2, 7/2) (b) ^(1/2, -1), B(-l/2, 1) 

(c) ^(3/2, -1/2, l),B(9/2, -3/2,3) 

(d) ^(3,3, -5/2), 15(1, 3, -3/2). 

Problem Set 2.3 

1. (a) 2 (b) -32 (c) -4 (d) 2 (e) 5 (0 -4 

(g) -4 (h) 0. _ 

2. (a) 1/V5 (b) -32/ Vi^ (c) -4/VW (d) -1/V442' 

(e) 5/V385 (0 -4/3yl4 (g) -4/^M2 (h) 0. 

3. (a) 2IV10 (b) -32/V37 (c) -4/V13 (d) l/VU 
(e) 5/Vll (0 -4/V6 (g) -4/V14 (h) 0. 

4. (a) (1.1) (b) (64/29,-160/29) (c) (-4/ - 8j)/5 
(d) (-31 -1- 5i)/17 (e) (1/7, 3/7, 5/7) 

(0 (-8/21,4/21,-16/21) (g) (4i - 4> _ 4A:)/3 (h) 0. 

5. (a) 3 (b) 0 (c) any real number (d) 2, 1. 



ANSWERS TO PROBLBIM / 301 


Problem Set 2.4 


3. cos « = — 2/\/17, cos p = “hly/n, cos y == 2/V17. 

4. r = « + /(» — «), where u and v are the position vectors of the 
given points. 

„ _ //' + mm' + tm' 

7. cos « = + „?) a ^ n'^) • 

8. cos-^ (2/3), cos * (—2/3), cos-^ (1/3). 

9. 2^ + 3;' 1 - 6r = 35. 

10. 3i - 2J + 6ft. 

11. (a) w/4 (b) 7C/2. 


Problem Set 3.1 

1. (a) (1,5, -1,12) (b) (16,-100,2,-6) (c) (0, 0,0,0) 

(d) (-3, 19, —12, 13) (e) (0, 6a - 2b, 3a + 36, 3a — 56). 

2. Yes. 4. (a), (d), and (0 are vector spaces. 

6. (a), (d), and (f) are vector spaces. 

7, (a), (c), (d), and (f) are vector spaces. 


Problem Set 3.2 

4. (c). (g)» ao<* (*) are subspaces of F,. 

3. (b), (d), and (e) are subspaces of 9>. 

6. (a), (b), (d), (e), and (f) are subspaces of (a, b). 

Problem Set 3.3 

1. (a), (c), and (d) are in [S]. 2. (c) is in [S]. 

6. (a) x;>-plane (b) xy-plane (c) F, (d) F,. 


Problem Set 3.4 


5. 


6 . 


(a) {(Jfi, JCg) G F, 1 xi = 0}; subspace of F, 

(b) {/ G ^(-2, 2) I /(I) = /(- 1) = 0); subspace of (-2, 2) 

(c) {/G '?’(-2. 2) I = 0 and * 


(d) 

(a) 

(b) 

(c) 


subspace 

{p & 9\p(x)= p{-x)}', subspace of 9. 


{(2, 2), (4, 1), (1. 1), (3. 0)>; subset 

{(4, 3), (8, 6), (3/2, 1). (11/2, 4), (1 + V2. « - 2), (5 + V2, 


n + 1)}; subset 

{(5/2 - /, 11/3 - 20 1 0 < / < 1}; subset 
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(It is the line segment joining the points (3/2, 3/3) and (5/2, 

11/3).) 

(d) {(2 + 3/, 3 -f- 4/) I 1 < / < 2)}; subset 

(It is the line segment joining the points (5, 7) and (8, II).) 

(e) {(3 - t, 7 -f 20 I 0 < / < I); subset 

(It is the line segment joining the points (3, 7) and (2, 9).) 

(0 {(Jf, 2) I * > 1/2); subset 

(g) {(Jc,.y) I 2 jc 4- 3y *= 17}; parallel 

(h) {(X. 1 (X ~ 1)» + (y - 5)* = 1); subset 
(It is the unit circle centred at (1, S).) 

(i) {(3/, 4- 2/t. 4/i + 5/,) I 0 < /, < 1, 1 < /, < 2}; subset 

(It IS tie interior of the parallelogram PQRS, where the points 
P, Q, and S are (2, 5), (5, 9), (7, 14), and (4, 10), respec- 
tively, including the edges PS and QR.) 

0) {(til t*) I 0 < ti < 1, 2 ^ 4}; subset 

(It is the rectangle with vertices (0, 2), (0, 4), (1, 4), (1, 2), and 
its interior.) 

(k) Vi ; subspace (I) K, ; subspace. 

7. (a) {(I -f t, 2 + 2/, 1) I / a scalar}; parallel 

(It is the line through the point (1, 2, I) and parallel to the 
vector (1,2,0).) 

(b) {(x, >■, z) 1 X f y + z = 3}; parallel 

(It is the plane through the point (3, I, — I) and parallel to the 
plane x + y 4 z = 0.) 

(c) {(1 4 — 3 4 2a, 4 4 3a 4 P) 1 a, P scalars}; parallel 

(It is the plane through the point (1, —3, 4) and parallel to the 
plane 2x — y = 0.) 

(d) {(* 4 3P, 2a 4 P, 3a) | a, p scalars}; subspace 

(e) Vi ; subspacc (f) Kj ; subspace (g) B ; subspace. 

It 

12. (b) Base space : {(x,, x,, ..., x„) | S a,x, = 0} 

i-l 

Q 

Leader : - e,, aj ^ 0. 

13. (a) Base space : set of all constant functions Leader : x* 

(b) Base space : set of all constant functions Leader : i^/2 

(c) Base space : (ax 4 M o^i P scalars} Leader : —sin x 

(d) Base space : (ax 4 P I P scalars} Leader : x*/12 +• x»/3 
4 3x’/2 

(e) Base space : {/ G 9^ (0, 2) | /(I) = 0} Leader : x 4 1. 

14. (a) P n = {0} (b) U+1V=‘ {/. 4 /a |/„/, e e’(-o, a), 

fx is odd and/, is even}; V + W = 9^(-a, a) ^ V ® W. 
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Protflem Set 3.5 

1. (a), (b), and (d) are u. 

2. (a), (c), and (e) are ld. 

3. (a) and (c) are u. 

4. (a) and (e) are Li 

11. (a) S (b) S (c) {(1.1.2),(~3, 1,0).(1. -1,1)} (d) 5 

(e) {(1/2, 1/3, 1), (2. 3/4, -1/3)}. 

12. (a) {(1,0, 0.0). (1,1, 0.0). (1.1, 1.1)} (b) 5 

(c) {(1, 1. 1, 0), (3, 2, 2, 1). (1, 1, 3, -2). (1. 1, 2. 1)} 

(d) S (c) {(1,2, 3,0), (-1.7. 3, 3)}. 

13. (a) S (b) {1, X + jc*, * — X*} 

(c) S (d) {x* - 4. X 4 - 2, X - 2}. 

14. (a) S (b) (sin* x, cos 2x) 

(c) {sin X, cos x} (d) {In x) (e) S. 

15. 1(c) (1,2, -3) 1(e) (0,0,0) 2(a) (0.0, 1,1) 

2(c) (1,2,6, -5) 2(c) (1,-1, 1,-1) 3(b) 3x 3(d) x*/3 
4(b) 1 4(c) iin (x + 1) 4(d) In x*. 

Problem Set 3.6 

1. (a) Notabasis;{(l,2, 3),(3, 1,0)} 

(b) Not a basis ; {(I, 1 , 1), (I, 2, 3)} 

(c) Not a basis ; {(0, 0, 1), (I, 0, 1), (1,-1, I)} 

(d) Basis (e) Not a basis ; S. 

2. (a) Basis (b) Basis (c) Not a basis (d) Basis 

(e) Basis (f) Basis (g) Not a basis (h) Basis. 

3. (a) 2 (b) 2 (c) 3 (d) 3 (e) 2. 

4. (a) 4 (b) 4 (c) 2 (d) 4 (e) 5 (0 4 (g) 3 (h) 3. 

5. {(3, -1. 2), (1, 0, 0). (1, 1, 0)}, {(3, -I. 2), (0, 1, 1), (2. 1, 2)}. 

6. (a) 1;{(3,2, 1)} (b) 3 ; {(1, 2, 3), (0, 1, 2), (1, -2, 3)}. 

8. (a) {l,x} (b) {(x - Xo)*. (Of - *o)*. (JC -- Xo)*, (JC - Ab)*} 

(c) See Problem 1 1 

(d) {(1. 0. - 1, 3, 0), (0, 1, -1, 0, 0), (0, 0. 0, 7, 1)} 

(e) {(X - X,), (x - X,)*, (X - x^», (X - X#)*}. 

12. (a) -1/2, -1/2, 3/2 (b) -3/2, -5/2. 7/2 

(c) — Xj, ^Xj — Xj •I' Xj, ”*"^Xi 4* Xj 

(d) e,-^j-«4-c,^4-x 

(e) -21/4,13/2,47/12 (0 2,0, -1. 

13 . (a) - 1 , 6. -2 (b) - 2 . -1,3 (c) -1, 1, -I. 
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14. {(1. 0. 0, 0). (-5, 3 4. -6), (0. 0. 1, 0), (0, 0, 0. I)}. 

II R R 

15. X S QC||Xt. ...y X 

<=1 /»! i 1 

16. 2. 

17. A = [(1. 0. 0, 0), (0. 1 . 0, 0)]. B = [1, 1, 5, 2), (1, 2, 3. 0), 

( 1 , 1 . 1 . 1 ) 1 . 

Problem Set 4.1 

2. («•'. (d), (f). (g), (h). 0). (k). (I), (n). (o), (p). and (q) are linear. 

3. (a) Yes ; = {-x|^ + 5>'/3, 4*/3 - 2>'/3) 

(b) Yes;7X*.y) = ( 23 '.>') (c) No 

(d) Yes ; T{x, y, r) = (y -i z, xjl + 2y — zjl, 2x - 2y + 2z) 

(e) Yes ; r(ao + a,X + OjX* + ajX*) = (— «o + 2a.^ + a^X 

+ 3(*, - ai)x* 

(f) Yes ; 2'(«o ■i *»** "i" *4**) = ■" 2 »^ + 3«i + 4«| 

(g) Yes ; 7Xx, y) = (x - iy, x - y - iy). 

4. lXx,y)^{0,y-x). 

5. nx,y)^(^-^^.y). 

Problem Set 4.2 

1. (a) V,;2 (b) [(M.0),(0. 1,1)];2 (c) V,;3 (d) K,;3 

(e) n;3 (f) [(1, 1,1,0). (0, 1, 1,0), (0,0,1, I)]; 3 

(g) (h) {pe9> |p(0) = 0} (i) {p e ^ |p(0) - 0) 

(j) 9 (k) ^'(0.1) 0) (TCO. 1). 

2. (a) n;0 (b) ^;0 (c) F,;0 (d) V.iO 

it) [(1, -1, 1. 1)1 ; 1 (0 Vo lO (g) K,;0 (h) F,;0 

(i) Set of all constant polynomials ; 1 (j) i 0 

(k) V^;0 (1) Set of all constant functions ; 1. 

6. TXXj, x„ X,) = (4xji - 3x, + X,, 8xi - 6x, + 2x„ 0). 

7. TXxi, x„ X,) = (Xj + x„ X, + 2x„ — 4xi + 3x, + 2x,). 

8. (a) : (a), (b), (c), (d), (f), (g), (h), (j), and (k) are one-one 

(b) : (a), (c), (d), (e), (g), (j), (k), and (1) arc onto 

(c) : (a), (c), (d), (g), (j), and (k) are one-one and onto. 

Problem Set 4.4 

1. All are nonsingular; 

* 1 . *s) — i(4Afi + *1 - 3x„ 4x, - 4x, - 3x*, 

— *1 + *1 + 2 x ^ 
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S-^(Xu x„ = K 7 xi + x„ 7*1 + 7 x, + 2x„ -*,) 

*». *3) « t(- 9 x„ - 2 xi - 5 x, - 3 xa, 5 x, + gjt, + 3 x,). 

2. (a) T~f-{xi, X*) = {xjtti, Xj/aj) 

7* Xj, X 3 ) ~ {xj Xj^ Xg X 3 , X 3 ) 

(c) r- ‘(o-o + «i* f «***) = («o/3 - ai + 2a*/3) + ( 203/3 
+ Oj ~ 2a*/3)x f (— 03/3 + a|/ 3 )x*. 

Problem Set 4.6 

1. (a) (25 + 3r) : (xj, x*) h-> (7x, + Sxg, 6 xi + 8 X 3 ) 

(b) (35 - IT) : (xi, x.) (-X, - 7rg, 9x^ 12x,). 

2. (a) (5 + r) ; (Xi, x*, x,) >-»• (2xi — 2xj + Xj, 5v, + 6 xg j x„ 

Xj + 2X3) 

(b) (35 — 27’) ; (Xi, x*, Xg) H-> (- 4x, -h 'Jxg + 3 x 3 , - 5xi ~ 12x, 
+ 3x., -3xi f- X 3 ) 

(C) (a5) • (x„ x„ X 3 ) (oXg [ ax„ axi + 0 X 3 , - oXg + 0 X 3 ). 






^8 


(a) R (- 25 3^1 — Cg 1“ 7Pg lOpg 

(b) 2/f + 5r 7e, - 3«g + 5e^ 17ei - 2?, - 23^3 21<?i - 2^3 


(C) 5 - r 


—3^1 -f- «g + Seg — 2^g + *1 ~ 5e* 


(d) ^ + 5 + 2 r 4 €, - 2 «, + 2^3 7e, - 9f3 lOe^ + e, - 7e, 


(e) o/t + P5 
+ rT 


(o + P + Tf)^i (« + 3y)Pi 
+ (o — P — y)«« + (—* + 

+ Y «8 + (« - 5 y )<'3 


( 3 « + p + 3 Y)e, 
+ P ^8 + (^~ 7 p 
- 2r)e, 


7. (a) 7Xxi, Xg, Xj, Xg) = (xg + 2xg, - Xg + Xg — x«, — x» + Xg, 

-Xg + * 4 ). 

5(Xi, Xg, Xg, Xg) = (Xg - Xg + X 3 , Xg + JC, + Xg + x«, 

Xg + x«, 2 xg) 

(b) r(x„ Xg, Xg, Xg) — (xg f x«, Xi -1- X 3 + Xi, — Xg + Xg, Xg), 

S(Xi, Xg, Xg, Xg) - (xg — 2xg — 4 x 3 , 2xa + 2x«, Xg + Xg — x*. 

JCg +- Sxg) 

(c) TTfXg, Xg, Xg, Xg) = (xg, Xg + Xg - Xg, 2xi + Xs, x, + feg), 

^(^ 1 , JCa. Xi) = (Xg + X 3/2 + 3xg/2, -Xg/2 - X 3/2 + xJ2 

Xg/2 + 3xg/2, 2x, +-Xg + Xg/2) 


(d) r- 5 . 
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Problem Set 4.7 

1 > *•) 

2. (a) (STXXi. X,) - (2 jci + 2x„ 3xa + 3x,) 

(b) {TS)(xu - (5x, + 4af„ 0) 

(c) S*iXi, X,) *= (4*1, 18xi + 16x,) 

(d) {r«5)(xi, X,) = (5xi + 4*1, 0). 

3. (a) (S70(xi, X,, *,) = (4*1 4 6*, 4- x„ 2*, - 3*, 4- x„ 

—2*1 4- 3*, 4- X,) 

(b) (rS)(*i, *„ *,) — (—3*1 4- 2*1 — *„ 6*1 4- 4*1 + 10*„ 
~Xi 4- X,) 

(c) (SrS)(Xi, x„ X,) = (5*1 4- 4*1 4- 1 Ixj, -4*i 4- 2*„ 

2*1 — 2*, 4- 2*,) 

(d) {TST){Xu *1, *,) = (2*1 4- 21*, - *a, 28*, 4- 6*, 4- 10x„ 
—2*1 4- 3*, 4- X,). 

4. 




<1 

^3 

(a) ST 

2^x 

— “f* 35^a 

e, - 5e, 4- 14e, 

(b) RT 

3^1 + 

-i2ei 4- 3#, 

- 20e, 

— 3ei 4- 3e, — 8e, 

(c) RST 

-20^1 4- 3e, 

- 29e, 

95^1 4- 6e, 

+ 132e, 

38ej 4" 6e, 4* 51e, 

(d) R{S 4- T) 

3fi 4* 4e, 4~ 2e, 

— llei 4- 2e, 

— 19e, 

— 22ei 4- 3e, 

- 35e, 

(e) r* 

«! - e, 4- 4<>, 

— 12^1 — 3f, 

4- 13e, 

*“3ei *“ 3e, 4* ^e. 

(f) I*ST 

35^1 4- 22e, 

- 54e, 

-lie, - 79e, 

4- 13 3e, 

19ei - 28e, 

4- 37e, 


5. S(Xi, X,) = (*i — x„ X, - Xi), r(*i, *,) = (*„ *,). 

9. (a), (b), (c) Range : K, ; kernd : K, ; rank : 3 ; nullity : 0. 

14. (b) SiS^ is idempotent if SiS^ — is idempotent if 

SiS^ 4' •SfS'i = 0 

(d) IX*». *s. * (*i. *1. 0). S{Xi, X,, *,) ** (0, 0, *,). 

15. (b) Yet; 5 (c) Yes (d) No 
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(c) Less than or equal to the minimum of the degrees of nilpotence 
of S and T;S + T is nilpotent. 

17. (h) (/ + xr)~*(a, + »iX + «*•** ■¥ «j**) = «, -f »yX + (a» — X«, 
- 2Aot,)jr* + (a, - Xa, - X«, + X*(x, + 2X*a,)x*. 


Problem Set 4.8 

1. 


Range 

Kernel 

Pre-image of (3, —1, 2) 

R 

V, 

y^ 

(1, 2, 0) 

S 

y. 

y. 

(23/7, 18/7, -2/7) 

T 

y^ 

y^ 

(1, -7/9, 13/9) 


2. (b) i (c) (8/7. -18/7,3) (d) (1,3,2) 

(e) (1,-1, 3.0) + [(1,-1, 1,1)1. 

3. (a) : (h) 1 (i) x + [1] (j) — x/2 (k) * cosec * 

(1) -d + x)e^ + [IJ 

(b) : (h) ;r (i) W) + jl] (j) -(1 ^ **)/2 

(k) ac* cosec x (1) —(2 + 2x + Jic*)e-* + [I]. 

Problem Set 4.9 

1. (a) 2>-(r+e*V 

0>) T' “ + f + 2 cos * + (* — -^) sin *, * 9^ 0 ; — 0 

when X s 0 

(c) ^y = C(3x - 4)-*» - x»(3x - 4)-*», x # All 

(d) y = C«~“ + €*“/(« + P). « + P 0 ; = (C + x)*"" 

if P = -a (e) x=^Cy + ]^ 

(0 y^c/^ p#0;y = ?|? + «x + C 

if p « 0 (g) X Ce”**® * + tan * > — 1 

(h) X = Ce**“ ' + cos* y dy 

(i) (y - l)x - (y + 1)(C - y + 2 In (y + l)),y > 1 

(j) X •= C cos y + sin y (k) y(l + pc*) ■= C — cos x 

+ (X - l)e- + x»/3 

.0) yV(l + JC*) « c + I in ( ^<{-±^ ^ j ). 

2. (a) y(C + sinh-* x) » Vf* + 
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(b) /(Ce** + 1 + *») = 1 
(C) y\c+2x) = e** 

(d) x(C — >>*) s= e» (e) x(C cos y + sin j*) = I. 

3. (a) u ; yes (b) li ; no (c) ld ; no (d) ld ; no 

(e) LD ; no (0 ld ; no (g) li ; yes (h) u ; yes. 

Problem Set 5.1 
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7 . I 


ri n 


LI -U 


|. 


8. (a) 


n n 


Ll OJ 


I (b) 


-1 

on 


ri 

1 

1 “ 

1 

1 

(C) 

1 ■ 

-i 

0 

_0 

ij 


LO 

0 

1 _ 



r 

0 

0 

L 


ri 0 0 -11 



1 1 


1 


(d) 

0 0 1 

(e) 

oil 0 



_0 1 OJ 


LO 0 1 -IJ 


r 

0 

0 

1 

r3 2 0 c 

[ 

r 


1 1 0 


1 0 -1 C 


(0 


(g) 




1 1 ) 


JO 0-1 


_0 0 IJ 


r 

0 

0 

0 

1 


Problem Set 5.2 
1 . (a) T:V^-^V„ 

T{Xi, Xt, X*) = (Xi + Xg + 2x3 + 3x4, Xj + Xg Xg, 

Xg + 2x,) 


2 . 


(b) 

(a) 

(b) 


T: Fg- K,. 

71(Xii Xgi Xg, Xg) 


= ( 7 xi + 2 xg H llxg - 8 xg, llx, + 7 xg + 22 x, 
- 19 xg, 13 xi + 8 xg + 30 x, - 23 xg). 


J* ; Kg — ► Kg, T(xi, Xg, Xg) — (xg, Xg, Xg) 

r; K, -> Kg, 7T(x„ Xg, Xg) = (Xg + 2xg - 2xg, -Xg + Xg -h 2xg, 

Xg Xg + Xg) 


3 . 


4 . 


5 . 


(c) 

(a) 

(b) 

(c) 

(a) 

(b) 
(0 

r 

I 

L 


r : Kg -> Kg, r(xi, Xg, Xg) i(-*i - 4 ^* + ^*1 + ^■*** 

— 2 Xi + +“ 3X3). 

r : Kg -*• Kg, r(xg, Xg, Xg) = (Xg - Xg + 2 x„ 3 xg + Xg) 

r ; Kg -> Kg, n(*if Xg) = ( 2 Xg + 8 xg — 6 Xg, 2 xg — 8 xg 

+ 4 xg) 

r : Kg -► Kg, T(Xg, Xg, Xg) = ( 5 xg - 2 xg, -Xg - 2 xg). 
r : Kg -> Kg, IX*i. **) = (*i + 2 ^*' *»• 

r : K, -> Kg, TXXg, Xg) = ( 2 xg - x„ x„ 3 xg - 3 x 0 

r ; K, Kg, TXxg, Xg) = i( 2 xg + 4 xg, -Xg - 2 x„ - 17 Xg + Xg). 
C08 0 sin 6 n 

—sin 0 cos 0 _] 
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Problem Set 5.3 


1. 

(a) 

- 9 

4 

i3n 


r 

1 6 

7-1 

I 






1 

(b) 

1 







-.12 

9 

-5J 


L 

-7 1 

5J 






r 8 

61 


r- 

-1 

41 





2. 

(a) 

1 

1 

(b) 

1 


I. 







L19 

-2J 


L 

0 

5J 







r -16 

10 

- 6 


8- 


ri8 

I 

19 

12~ 

3. 

(a) 

-8 

-28 

-40 

— 

16 

(b) 

2 

28 

38 

18 



1 

L -6 

-4 

4 

- 

-6J 


_I9 

8 

6 

5_ 


r 2 -17 -15 -28“1 

I 

(c) 10 8 14 2 . 

_-15 -4 -14 3_ 


- 2 -7 -3n rl ~i 

4. (a) 14 -26 -12 (b) 1 -J 


L 6 

9 

5J 



-i 

HI 


(c) i 

-i 

h 

. 

_v 

f} 

-IJ 


--1 -5 

on 



-I -2 

3 



0 -9 

5 



_-l -4 

-ij 

1 


--1 -17 

-33 

i4n 

1 

5 5 

5 

— 

4 

0 lO 

44 

— 

6 

0 0 

-14 

— 

2 

- 0 0 

0 

36J 


V" 

i 

- s_ 
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“1 

1 

0 

0~1 





0 

0 

0 

0 





0 

1 

0 

1 





0 

1 

0 

0 





0 

0 

1 

1 





1_0 

0 

0 

Oj 





n 

1 

1 

0 

0 on 




0 

0 

0 

1 

0 0 




1 0 

1 

0 

0 

0 0 




« 

L.0 

0 

0 

0 

1 i_ 




dim V --- 

■ 5. 

The matrices with 

respect to the ordered basis {sin x. 

cos X, 

, sin X cos X, sin^ 

X, COS* x} arc 

1 

1 

-3 


-2 

0 0 

01 


1 

1 

2 


3 

0 0 

0 


(a) 

i ® 


0 

3 

4 - 

-4 



0 

0 

-2 

3 

0 


1 

1 

LO 

0 

2 

0 

3_ 


1 

— 

1 

1 

0 

0 

0“ 



- 

-1 

1 

0 

0 

0 


(b) 


0 

0 

-8 

-2 


1 

• 



0 

0 

1 

-2 

6 




0 

0 

-1 

6 

— - 

1 

U 



Problem Set 5.4 


1. (a) -1 (b) 9 (c) 3. 

2. (a) (2.3, 3)r (b) (8, 19. (c) The matrix [-1] 

3 I 2' 


(d) 


6 2 4 

-3 —1 -2 

L 3 1 2J 


>“11 

<.) 
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3. (a)' A£ 


r9 7-1 
I I, BA == 
L6 19 J 


r 2 


7 

I 

Lll 


1 31 

11 6 
8 15J 


(b) £A =. 


(c) .45 = 


(d) AB^ I 


(e) 5-d = 


r 5 

5 

6- 



-2 

-1 

-3 



9 

-8 

21 



L. 11 

13 

12_ 



-22 56 

i 3 n 



r 7 9 U 

3 5 

7 

,5.4 = 

= 

3 3 2 

_ 3 9 

4J 



L24 8 21 

r3 11 

j 

24 

12 20n 


L7 15 

24 

1 

28 36J 


r 3 

2 

1 


4 5n 

24 

11 

16 


19 38 

-1 

-1 

-3 


1 -1 

_ -6 

0 

-2 

- 

-4 -10_ 

ro on 


r- 

-2 

-2jn 

1 1 

,BA 

= 1 


1 . 

LO OJ 


L- 

-2i 

2_J 


4. (a) 


(d) 


ro in ri -21 

I I (b) I I 

Ll oj Lo IJ 


1/a 0 n 


L— P/ay 1 /tJ 


I (e) 


r 0 

Ll/P 
i' 


(c) 
i 0 

-I 1 -1 
L-4 0 ij 



“10 3 5n 


“25 21 33“ 

5. (a) A» = 

3 3 2 


9 10 12 

1 

r 

00 

1 


L27 6 13_ 


rl24 59 96 
45 26 37 
L 66 53 87 J 


1/P 1 
-«/P*J 
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r? 4n ri9 in r73 56-| 

(b) = I I , = I . 4* = 1 1 

L6 7J L27 19J L84 73J 

“10 5 10“1 r 35 60 801 

(c) A* =- -5 4-1 ,i4»= -20 3 -12 , 

L 5 45 50J L 20 340 355_ 

T 125 520 5951 

A* = -75 -54 -104 |. 


6. (a) 


7. (a) I 


Iv 75 2455 2505J 

r« -2P1 r« ? 1 r« oi 

I 1 (b) 1 1 I « I 

Lp « + PJ LP *-M LO PJ 

r « PI 

I I , where a and p are arbitrary scalars. 

L— P «J 

r 1 -n r iV -n 

I (b) (c) Solution does not exist. 

lv IJ U-A tJ 

-x,u. 0 ... 0 1 TMi 0 ... 0 1 


8. (a) 


rx,(*i 0 
1 0 


0 (aA 


L 0 0 

-1/Xj 0 

0 i/x, 


X«tA,J 
0 1 


L 0 0 


|*nX|i J 


,ifX, 7^ 0, / = 1,2, .. .n. 


L 0 0 ... 1/X,J 

9. (a) Nilpotent; 4 (b) Nilpotent; 4 
(c) Nilpotent; 3 (d) Not nilpotent. 

r, 1 - «n r « P n ri oi 
14. r P"l. 1 .±1 ^ I 


1 - «* 


LO IJ 


LP -« J L P J -■ 

r— 1 01 

4 - I , where * and P are arbitrary scalars with P # 0. 

LOU 

r -5 501 r-21 601 r 22- -241 

16. (a) I I (b) I I (c) 1 

L-25 45J L-30 39J L-24 46J 
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(d) 

(f) 


r-25 35n r 64 -70~1 

I I (e) I I 

L 35 -60J L-10 54J 

r 4119 -2546”! 

I I- 

L_-25460 37217J 


18. 

20. 

(a) * 
(c) ;r 

l,y 

-- -y 

= 1 (b) 
-= 4z = 2. 

Of = 

6/P, 3 ^ = (a? 

- M/P*,p/=o 



/ 


2)4 

2), 

2>4 

2). 

2). 

2)7 

/ 

I 

2)i 

2>, 

2), 

2>4 

2>* 

2), 

2>, 

A 

2>i 

I 

2), 

2). 

2)* 

2)4 

2>7 

2>. 

D, 


2)a 

2>, 

/ 

2>. 

2>7 

2)7 

2)4 

/). 

2), 

2)4 

/ 

2)4 

2)7 

2>. 

2>4 

2), 

2)4 

2>4 

2)* 

2>7 

2). 

2>4 

/ 

2)4 

2)3 

Db 

2). 

2^4 

2>. 

2>7 

/ 

2)4 

2>4 

2>, 

2>. 

2). 

2)7 

2>« 

2>, 

2>, 

2)4 

2)4 

/ 

2>, 

2), 

2). 

2>, 

2)4 

2>* 

2>a 

/ 

2>4 


Problem Set 5.5 

1. (a) Range : [(1, —1, 1), (3, 7, 0), (2, 2, 1)] = F, ; kernel : K* ; 
rank : 3 ; nullity : 0 

(b) Range : 1(1, 3), (-1, -2)] = F, ; kernel ; [(-1, 1, 1)] ; rank ; 

2 ; nullity : 1 

(c) Range : [(2, 7, 3), (0, 1,-1), (1, 2. 1)1 = F, ; kernel . F, ; 
rank : 3 ; nullity : 0 

(d) Range: [(2.0, 1,2), (1, -1, 2. 0), (2 2.4,3). (0.1. 3. 0)1 

— F* ; kernel : [(—15. 1, 9, 9. —12)1 ; rank : 4 ; nullity : 1 

(e) Range: [(1.2. 1,0). (-1.3. 5.0), (1, -1, 2, 1). (0,1, 0,1)1 
= F4 ; kernel : F, ; rank : 4 ; nullity : 0 

(0 Range : [(-1. 3. 2), (1. 1, 2), (1,-1, 1)1 = F, ; kernel : F, ; 
rank : 3 ; nullity : 0. 



ro - 2 n 

2. (a) i I I (b) i 

LI 


r 2 

-4 


r -1 


ij 
1 -r 
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« 


0 on 

2 0 


L 5 -4 IJ 


(C) i 


3 

-1 

5 







1 

L 

3 

-1 

3J 








r 

7 

-13 

8 

91 


“I 

- I 

0 

on 

(d) A 


-3 


0 

3 

(e) i 

0 

I 

-I 

0 


4 

-4 

8 

-12 


0 

0 

0 

2 



2 

10 

-8 

6_ 


_0 

0 

2 

-2_ 


3. «* + p» / 0 ; 


«» + 


cr 

P* 

L-ap 


ap 

a® —ap 

P* 


a*_| 


Problem Set 5.6 


(d) 

(0 

(0 


n -I 3n 

I 

r I 31 

r -2 7n 

1 

I 2 I i 

(b) , 0 -1 

(c) , -3 0 

I 

L3 2 -2J 

L-1 2J 

r 

L_ 

r 4 -2 7n 


I 

n 

1 

1 

oc 

1 

I 

I 

Cli 

(c) 1 

1 


' L 8 4 - 4J 

L I -3 8J 



r-2 -3 sn r 3 -2n r 2 

I I (8) I I t**) 1 , 

L 7 0 4J L~2 loj L2 

r 2 3 in 

i I- 

LO -1 5J 


2 21 
I 

■1 4J 


ri - / -1 + n 

5. (a) I I W 


n + i 2 


(c) 


.3 + i 2 + i J 

r2 - 3i 1 + 2i 3 - 4/n 
I I 

L2 + / 2 + 2i 2 - / J 


2 + 3i 1 - 4/ 
Ll - » 3 + 2iJ 
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r * 1 2 + / 1 -/ n 


1 +i 


-i 2 


L-1 - 2/ I 3 - 2/J 
6. ax* + by* + rz* + 2hxy + 2fyz + 2gzx, 
9. (b) A diagonal matrix. 

Problem Set 5.7 


“1 

0 

*" 

n 

0 

-1 

-1“ 

0 

1 

-i 

(b) 0 

1 

3 

2 

Lo 

0 

0_ 

LO 

0 

0 

0_ 


“1010 3“ 

0 110-2 
_0 0 0 1 0 _ 


“1 0 0 on 
0 10 0 
0 0 10 
_0 0 0 1 _ 


“1 

0 

0 

0 ■ 


“1 

0 

0 

-2n 

n 

0 

0“I 

0 

1 

0 

0 






0 

1 

0 





(f) 

0 

1 

0 

1 

(g) 



0 

0 

1 

0 


_0 

0 

1 

-3J 

' 0 

1 

0 

h 

_0 

0 

0 

Ij 






LO 

0 

OJ 


-10 0 

0 10 A- 

0 0 1 

_0 0 0 0 _ 



“100 2 “ 
0 I 0 -I 
0 0 1 1 

L.0 0 *0 0_ 


2. (a) 2 (b) 2 (c) 3 (d) 4 (e) 4 (0 3 (g) 3 
(h) 3 (0 3. 

3. Same as the answer to Problem 2. 

“1-5 1 5“ 

4 1-3-1 

4. (d) Nonsingalan | 

-3 1 4-1 

_ 1 16-6 -9_ 
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“ 3 3 -3 31 

7 3-5 4 

(e) Nonsingular; i 

-10 2-1 

_ 5 3 -4 2_ 

5. (a) * = 14/19, j; = 3/19, 2 = 13/19 

(b) * = 7/4, 1/2,2= -5/4 

(c) x= 1/9, y = - 2 / 9 . 2 = -1/3 

(d) X = 5/7, y = 1 , 2 = 3/7 

(e) x = 8/5,y = 5.2 = 9/5. 

7. ki = 2, k, = 4, kt = 6 , *4 = 8 , fe, = 9, *, = 10. 

Problem Set 5.8 

1. (a) Consistent; JCi = 5/16, ** = 1/16, Xt = 3/16, x^ = 1/8 

(b) Consistent; = 2, x, =» 1, x* = 0, jr 4 == 0 

(c) Consistent; (1, 0, 0, 0, 0) + ((0, —4, 1, 1, 0), (0, 3, —1, 0, 1)] 

(d) Consistent; (1, 0, 1, 0) 4- l(~2, 1,0, 0), (0, 0, —2, 1)J 

(e) Not consistent (f) Not consistent 

(g) Consistent; J(2, 1,1,0) + 1(2, - 8 , -5, 9)] 

^h) Consistent; Xj = 7/6, x^ = 41/6, Xj = 1/3, X 4 = ^59/6 
(i) Not consistent 0) consistent 

(kl Consistent; Xi = x* = 2 , x, = 0 
(1) Consistent; Xj = — Xg = 1, x, = 0 

(nj) Consistent; (7, 6 , 14, 3, 0) + [(0, 14, 14, 1, 1), (7, —1, 12, 3, 4)] 
(n) Consistent; (1, —2, 0, 0) + [(—4, 7, 26, 1)]. 

Problem Set 5.9 

“7-3 - 8 “ 

1, (a) Nonsingular; 4 3—1—4 

_-7 3 10_ 

r-3 1 n 


(c) Nonsingular; 


J 


1 1 -3 

10 -2 - 2 _ 
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- 16 7 -I -7“l 

-6 1 4-1 

(e) Nonsingular; iV 

7-656 

_-7 6 -5 23_ 

-- 3 - 1 2-1 

(f) Nonsingular; i S 3—2 

__4 -4 4_ 

2. Same as the answer to Problem 2 of Problem Set S.S. 

3. Same as the answer lo Problem 4 of Problem Set S.7. 

Problem Set 6. 1 

1. (a) Even (b) Odd (c) Odd (d) Odd. 

2. (a) Even : (1, 2. 3). (2,3,1), (3, 1,2) 

Odd: (1,3, 2), (2,1,3), (3,2,1) 

(b) Even : (1, 2, 3, 4), (1, 3, 4, 2), (1, 4, 2, 3), (2, I, 4, 3), 

(2, 3, 1, 4), (2, 4, 3, 1), (3, 2, 4, 1), (3, 1, 2, 4), 

(3, 4. 1, 2). (4, 2, 1. 3), (4, 3, 2, 1), (4, 1, 3, 2) 

Odd : (1, 2, 4, 3), (1, 3, 2. 4), (1, 4. 3, 2), (2. 1, 3. 4), 
(2, 3, 4, 1), (2, 4, 1, 3), (3, 2, 1, 4), (3, 1, 4. 2), 

(3, 4. 2. 1), (4, 2, 3, 1), (4, 3, 1. 2). (4, 1, 2, 3). 

3. (a) 6 (W 10. 

4. (a) ix - y){y - z){z - X) (b) (*-;,)(;,- zXr - *) 

(c) a* + 6* + c* — iabc. 

Problem Set 6.4 

1. n*. 

3. (a) -20 (b) -4 (c) 6 (d) 6 (e) 500 (0 0. 


Xn 


Xt ... 

Xn 

n 



Xx ... 


= II (*, + + ... + 

l*=l 

** 


JC4 ... 




where «>i, <>>| u, are n n-th roots of unity. 
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!■ 

1 

X* 

4 y» 

+ Z* 

* 

y 

z 

1 









1 


4-y! 

+ 2? 


yi 

2l 

1 








7. 

(b) 

X* 

4-y’, 

f 2^ 

x» 

y» 

Xi 

1 ! 


0. 









4-yJ 

4- 

Xt 

yz 

h 

1 










X* 

t- v| 

4* 2i 

Xt 

y* 


, 1 








8. 

X = 

0, 

—a — 

• b - 

c. 

















r 

2 


0 1 

on 


— _ 

-1 

1 - 

-1- 



r 

0 - 

2-\ 












10. 

(a) 

1 


1 

(b) 

- 

-4 


2 

° 1 

(c) 


3 - 

-1 

5 



Ll 

IJ 











3_ 







L 

5 

— 

4 

ij 



3 

-1 



r 

1 

-7 

13 

- 8 

-- 

9 n 



1 - 

-2 

2 

0 

on 




1 

t 

3 

-9 

0 


3 



1 

1 

0 -: 

2 

2 

0 



(d) 

1 






( 

el 

1 





# 


1 

-4 

4 

-8 

12 




0 1 

0 

0 

-4 




L 

-2 

-10 

8 

- 

1 

6J 




0 1 

0 

-4 

4J 



Problem Set 6.5 

2. Same as the answer to Problem 1 of Problem Set 5.5. 

4. Same as the answers to Problems 1 and 2 of Problem Set 3.5. 

5. Same as the answer to Problem 2 of Problem Set 5.5. 

Problem Set 6.6 

5. 0. 

Problem Set 6.7 

1. (a) x-=-\,y=^4 (b) * = 31/11, y ■= -5/11 

(c) X - -2,y^ 29/2, z = -8 (d) x = -1/2, y = 5/2, z = 2 
(e) X -= 25/2, y = -17/2, z = -1/2. 

2. (a) Xi = 5/16, X* = 1/16, x, = 3/16, x* = 1/8 

(b) Xj = 2xj = 2, Xj — X4 = 0 

(h) Xi - 7/6, xj = 41/6, X, = 1/3, x« = -59/6. 

3. Inverses of the coefficient matrices : 


I 

-in 

1 

r 4 3n 
(b) A 1 1 

(c) 

F-1 

4 

-1 

5 

1 

J 

L-5 

3J 

L-1 2J 


L-2 

-3 

J 

2J 
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r-1 

\ -n 


--1 

i 

-n 

(d) 

0 


1 

(e) 

0 

-f 

1 

1 

1 

L 1 

-2 

IJ 

1 

_ 1 

-i 

0_ 


The solutions are the same as those of Problem 1. 
4. *' = Jc cos a + sin «, y' — —x sin a + >’ cos a. 


Problem Set 6.8 

1. (a) 0. 5;Jir, -=[(1. -3)],A:,= [(1.2)] 

(b) /. = [(/, 1)]. K_i [(-/, 1)] 

(c) -3. 2 ; a:-, = [(!•, - 1)J, K, = [(3, 2)] 

(d) - 1, -1. 8 ; A:_i = [(1, -2, 0). (0. -2. 1)], AT, = [(2, 1, 2)] 

(e) 1, 1. 0 ; ATi = [(0. 1, 2)], AT, = ((0, 0, 1)] 

(f) -I, -i, 2/ ; K_i = [(1, 0, -1), (0. I, -1)], Ku = [(1, 1. 1)] 

(g) -1, i, 1. 3 ; ALi --= ((1, 0, -4, 0)]. AT^., = [(-8. 6. 8, -3)]. 
ATi = [(-3, 2, 2. 0)1, AT, = [(1, 0, 0, 0)]. 


rt on r-3 on 


2. 1(b) 1 I 1(c) 

LO -U 

--1 0 0 0 - 

0 i 0 0 


I 1 

L 0 2J 


1 ( 8 ) 


0 0 10 
L 0 0 0 3_ 

ri 0 0 on 

! 0 1 0 0 


I 0 0 -i 0 
LO 0 0 -IJ 


Problem Set 6.9 


2. (a) C«f«- (b) C (c) -4/|l-**| (d) -2\x\\ 

where C is an arbitrary constant. 

3. 0. 


Problem Set 6.10 

1. (a) 4f+7-3A (b) 4i-7/ + 2ft (c) (-3, 1, -7) 
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(d) (1,5, -3). 

4. « X V = 0. 

5 . (a) No (b) Yes (c) Yes. 

6. (a) 8 x + 4^-z= 19 (b) >--^+1=0 (c) 8x-7z-ll. 

8 . {a ' b X d)c - {a • b X c)dot {a - c X d)b - (b c X d)a. 

9. U|V2^ 

10. 3* — 4y + z = 11- 

U. */ll = J'/2 = (3 - 3z)/14. 

12. 4* + y + llz = 39. 

13. 3je + 4y 4- 7z — 13. 


Problem Set 7.2 


1 2 --JL 

1. 1(a) {(yj,, • ^66* 


V66 


), 


' Vii’ vii 


VI 1 


1(b) {(1,0, 0), (0, V2’ V^^^ 


1(d) {( 


1 


( 


V30 
5 


5 

V30 

1 


2 1 ^ _1J^) 

^ vr95’. vn>5’ vi95 ’ 




V26 V26 

2- 2(b) < V^' “V30’ 


( 


12 


n-_«_ ?_)( ^ 


‘ V»5 ’ ’ V205’ V205 V41 

2(d) {(0, 0, 1, 0), (^, 0, ^). 

17 46 


1 6 

" v4r’ V41 


(- 


109 .. 

'* "• /TT^oe'f’ 


V14286’ V14286’ Vl4286 

,vra^_v^, + 


2V2 ** + ^2 * '*’ 2V2' 


3(c) 


^(47 - 42(,.+»^)). 
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5. (a) 0 (b) 0. 

8. If V, is the first vector in the span of the earlier ones, then the 
corresponding vector in the process of orthogonalisation will be zero. 

Problem Set 7.3 

6. Yes. 


Problem Set 7.4 




r6 

1 

r 

0 

0 


ri8 0 

1 

on 1 

-7 

0 

on 

1. 

(a) 

0 

1 

6 0 

(b) 

1 0 ^ 

0 1 (c) 

0 

V7 

0 



Lo 

0 3_ 

1 

LOO 

4J 

_0 

0 

1 

~4 

L_ 

2. 

(a) 

4.A* 

- 9v* = 

= 36 

or -9a* 

T- Ay^ =- 36 





(b) 9a* - 4j'* -- 36 or - 4x‘ ( 9v* - 36 

(c) 9x* + 4;;* = 36 or 4,x* f 36. 

Problem Set A 1 

1. (a) Qe-* + Cjjre *' (b) y — cos 2.% 4- Q sin 2 a: 

(c) y - Cl + C, cos A + Ca sin a (d) y C,e*^'* -i C^e-* 

(e) y ^ C,<»' -I- e "*( 0 * cos (v 3 a/ 2 ) \ C, sin (V 3 v/ 2 )) 

(f) y - Cie*' 4 C^e ' (g) y '^2;a 

(h) y Cic' 4- CiXe^ + C^e ' 

(i) V -- Cl 4 C\.x 4 Caf'^ |- C^e 

(j) J' Cl I ^ C,e *' 

(k) y - ((Cl + Cix) cos i\7x) 4 (C, f C«A)sin (■\/Tx))e-** 

(0 y (C, 1 Cax)f' I- (C, 4 CaA)e-' 

(m) y ^ (C, 4 CiAr)<?*' f (C3 4 - C^x)e• 

(n) y -= C,e-( 3 fv' 5 'Y /2 ^ Qe-(3-v'5u/2 

(o) y = Qe"* + Qe f C3 (p) - Cj 4- (Q + QxW^ 

Problem Set A2 

1. (a) 3 ’ = Cl cos 2a 4- Ca sin 2x — (a*/ 8 ) cos 2a 4- (a/16) sin 2a 

(b) y -- Cic** 4- CjAC*' 4- (2 a 4- l)e-**/32 

(c) y — Cl cos 2a 4- C, sin 2a 4* (1/4) cos 2a In cos 2a 
4- (a/ 2) sin 2a (d) y = Ci«**/» 4- C,e-* 4- 3«*/2 

(e) y — Cl cos (a/2) 4- Ca sin (a/2) 4* sin (a/2) In (sec (a/2) 

4* tan (a/2)) — 1 (f) 3 > = Cj cos A 4 - Ca sin A — (a/2) cos a 
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(g) y — Cif** 4- CiXe-^ 4- 

(h) y Cjt-'/* I- Qe 4 (3x 4- l\)e-'l9 

(i) y - - Cl f Cj cos X f C, sin * - 2x 4- JC*/3 

(j) y Cl |- Cjc' 4 Qe * - cos x - (x/2) sin x 

(k) y - Cie** ^ C,e' f Cje * 4- xe'^/S 

(l) y -=- Cl >r 1- Qe * 1 2vt'-<V3. 


Problem Set A3 


1. 


(a) y -= CiP' 4 - C^e *■ - 

(b) y “ Cl cos 2 x J Ci sin 2 x 

(c) y -= (Cl cos X -j- Cj sin x)t’ 


(a/ 4 ) cos 2 ic 



(d) y - C’tc'^"' ' -I cy ^ ^ I- sinh x 

(e) y =- C.f* )- Cixe' |- CjC- |- (2 cos x 4 2 sin x i- 2 xr-' 

+ x*e * 1- m 


(f) y Cl 4 - cos 3 x 4 Cj sin 3 x 4 x^lS 

(g) V - (<i cos (V3x/2) f C, sin (v'3x'2)V-- ^ H C,e* 4* C.e-* 

X* 4- 2x - 5 4 4 2x®) cosh x - (6x 4- x^) 

si ah x} 


(h) y - Cl \- Cg cos jc + Q sill X - X cos x 

2 x’ 1 07 

(i) >- --= Cl + C*x 4 - c,e' 4 Qc - - ^ x^ - 1 333 cos x 

- 169 sin ^ i- 1*3 ^ ^ 26 * 

0 3 ^ = Cl 4 C.«'- 4 C,e-” - xVl 2 4 - Jr /36 4 jq-'cos x 

I i X^”®** “4 X®P~®^ 

4 - -gysmx- jg e 4 ,qq JCf 20 

(k) y = (Cl cos (v 7 je) + C'l *>« (V^x))e *“ 4 - ~xe-»* 


— 2 ®”** sin 3 x. 


Problem Set A4 

1. (a) -^(2x-l)c- (b) -|-( 2 x + 3 4-2«»') 
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1 3 

(c) — **/10 — 4x/2S jj- sin x + cos x 

(d) -l(3x + 2)«- - -|-(3x - 2). 

2. (a) — e-**/29 (b) (sin 3x — 6x cos 3x) 

(c) (sin 2x — 10 cos 2x)c" 

(d) — “ (2 cos 2x + sin 2x) 

(e) (250JC* + 475x* - I940x + 388)f« 

(f) -«**cosx (g) j-J ^ (7x + 2)e->* (h) g|o 



Index 


Abel’s formula, 240 
addition function, 12 
additive inverse, 42 
associative operation, 19, 20, 134, 
167, 291 

auxiliary equation, 277 

Base space, 81 
basis, 95 

orthonormal, 262 
standard, 97, 161 
Bernoulli’s equation, 143 
binary operation, 17 

Cartesian product, 6 
central quadric, 267 
characteristic 
equation, 234 
polynomial, 234 
value, 234 
vector, 234 
circulant, 223 
coe£5cient matrix, 195 
cofactor, 216 
collinear vectors, 89 
column, 150 
rank, 187 
vector, 148 

commutative operation, 18, 20, 291 
complement, 5 

complementary function, 142, 276 
composition, 24, 133 
coo^ioate vector, 99 


coplanar vectors, 89 
Cramer's rule, 231 
cross product, 241 
direction of, 242 
properties of, 242 

DeMorgan’s theorem, 7 
derivative family, 285 
modified, 286 
determinant, 204 

expansion of, 204, 219 
minor, 224 
product of, 227, 228 
diagonalisation, 237, 270, 271 
diffeiential equation, ordinary li> 
near, 141, 144, 276 
homogeneous, 276 
nonhomogeneous, 280 
differential operator, 109 
dimension, 96, 100, 101 
direct sum, 80 
directed line segment, 37 
direction cosines, 59 
distance between points, 36 
distributive operation, 21, 134, 167, 
291 

domain, 10 
dot product, 50 
properties of, 50 

Echelon form, 1 88 
eigenspace, 236 
eigenvalues, 234, 236 



326 / INDEX 


eigenvectors, 234, 236 
elementary row operation, 187 
equality in y„, 64 
equivalent system, 185 
Euclidean space, 2S8 
existence and uniqueness theorem, 
144, 239 

extension of a basis, 99 
Field, 20 

finite-dimensional, 96 
function(s), 10 

absolute value, 12 
addition of, 25 
constant, 12 
equal, 24 
linear, 31 
one-one, 14 
onto, 13 

pointwise Sum of, 23 
polynomial, 12 
real-valued, 23 
scalar multiplication of, 26 
zero, 12 

Gram-Schmidt orthogonalisation 
261, 274 
group, 21 
abelian, 21 
commutative, 21 
orthogonal, 263 
unitary, 26S 

Homogeneous equation, 139 
hyperboloid of one sheet, 273 

Identity, 21 
function, 12 
map, 109, 115, 122 
image, 10 

indicial equation, 277 
infinite-dimensional, 96 
initial value problem, 143 
inner product, 50, 164, 258 


natural, 259 
space, 258 
intersection, 5 
of subspaces, 77 
inverse 

of element, 21 
of function, 29 

of linear transformation, 122, 
123, 125 

of matrix, 167, 177, 200, 226 
inversion, 203 
matrix, 200 
invertible, 168 
isomorphic, 127 
isomorphism, 122, 127, 160 

Kernel of a linear transformation, 
114, 116, 139 
matrix, 176 
Kronecker delta, 152 

Leader, 81 

left-handed system, 34 
line 

equation of, 56 
in vector space, 89 
linear 

combination, 74 
finite, 74 
nontrivial, 86 
trivial, 86 

equation, system of, 195 
extension,'! 1 1 
operator, 107 
transformation, 107 
idempotent, 137 
natural matrix of, 156 
nilpotent, 137 
nonsingular, 122, 127, 135 
nullity of, 117 
product of, 134 
range of, 114, 116 
rank of, 117 
scalar multiple of, 129 
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similar, 253 
sum of, 129 
variety, 81, 139 
linearly 

dependent, 87, 88, 93 
independent, 87, 88, 93 

Map, 10 

linear, 107, 155 
zero, 109, 115 
matrix, 149, 155 
addition of, 1 39 
adjoint, 222 
augmented, 195 
characteiistic equation of, 234 
characteristic polynomial of, 234 
chaiacterislic value of, 234 
characteristic vector of, 234 
conjugate, 182 
diagonal, 181 

diagonalisation of, 237, 270, 271 

eigenvalue of, 234, 236 

eigenvector of, 234, 236 

entries of, 1 50 

equal, 155 

Hermitian, 182 

idempotent, 182, 229 

identity, 152 

involutory, 172, 230 

lower triangular, 1 82 

multiplication of, 164 

nilpotent, 171, 229 

nonsingular, 168 

nullity of, 176 

orthogonal* 264 

polynomial, 172 

product of, 164, 165 

prop'^r value of, 234 

proper vector of, 234 

range of, 175 

rank of, 175, 188 

scalar, 182 

scalar multiple of, 159 
similar, 253 


singular, 168 
skew-Hermitian, 182 
skew- symmetric, 182 
square, 155 
sub-, 224 
sum of, 159 
symmetric, 182 
transpose of, 1 80 
transposed conjugate of, 182 
unitary, 264 
upper triangular, 182 
zero, 153 
minor, 224 

multiplication function, 12 

Natural matrix, 156 

negative triple, 243 

nilpotence, degree of, 137, 171 

nonhomogencous equation, 281, 139 

nontrivial solution, 139 

norm, 259 

norma], 141 

w-tuples. 64 

addition of, 64 
null set, 4 
null space, 1 14 
nullity, 117, 176 

One-one correspondence, 15 
onto, 13 

operational methods, 289 
operator equation, 138 
polynomial, 290, 292 
order, 150 
orthogonal set, 261 
orthogonalisation, Gram-Schmidt, 
261 

orthogonally similar, 266 
Parallel, 81 

particular integral, 140, 280 
solution, 140, 276 
permutation 
even, 203 
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odd^ 203 

perpendicular distance, 62 
plane 

equation of, 60, 245 
in a vector space, 89 
vectors, 40 

addition of, 41 
pointwise product, 27 
scalar multiplication, 26 
sum, 25 

polynomial, degree of, 1 2 
position vector, 40 
positive triple, 242 
pre-image, 13, 141 
proper 

values, 234 
vectors, 234 

Quadric, 267 
tangent to, 267 

Ranjje, 13, 114, 116, 175 
rank, 117, 175, 188 
column, 187 
row, 187 

rank-nullity theorem, 120 
reflection, 109 
relation, 8 

equivalence, 8, 128, 194 
reflexive, 8 
symmetric, 8 
transitive, 8 

right-handed system, 34 
ring, 23 

commutative, 23 
with identity, 23 
row, 150 

equivalent, 187 
operations, 187, 207, 209 
rank, 187 

-reduced echelon form, 188 
reduction, 188 
vector, 148 


Scalar, 63 

multiple. 26, 39, 42, 64, 129, 159 
multiplication, function, 12 
multiplication, properties of, 29, 
43 

product, 50 
projection, 53 
triple product, 244 
properties of, 244 
Schwarz inequality, 51, 260 
sequence, 13 
set(s), I 

addition of, 78 
empty, 4 
equal, 3 
finite, 15 
infinite, 6 
null, 4 

of complex valued functions, 66 
of continuous functions, 66 
of infinite sequence*:, 124 
of linear transformations, 130 
of m X n matrices, 156 
of R-times differentiable func- 
tions, 66 

of R-tuples of complex num- 
bers, 68 

of R-tuples of real numbers, 64 
of plane vectors, 41 
of polynomials with complex co- 
efficients, 66 

of polynomials with real coeffi- 
cients, 12, 66 

of real-valued functions, 25, 66 
of space vectors, 41 
shortest distance, 246 
singleton, 4 
skew lines, 247 
space 

coordinates, 33 
vectors, 40 
addition of, 41 
span, 89 
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stairs, 188 
steps, 188 
straight line 
in a plane, 57 
in space, 58 
vector equation of, 57 
submatrix, 224 
subset, 3 
proper, 4 
span of, 74 
subspace, 69 
nontrivial, 72 
trivial, 72 
superset, 3 

symmetric form, 57, 58, 61 

Target set, 10 
translate, 81 

translation function, 12, 109 
triangle inequality, 260 
trivial solution, 139, 196 

Undetermined coefficient, me- 
thod of, 285 
union, 5 

uniqueness, existence and, 144, 
195 

unitarily similar, 266 
unitary space, 258 

Variation of parameters, 280 
vector(8), 37, 64 
angle between, 48 


column, 148 
components of, 46 
coordinates of, 99 
difference of, 44 
direction of, 41 
equal, 41 
free, 38 

initial point of, 33, 37 
length of, 37, 40 
magnitude of, 37, 40 
norm of, 259 
orthogonal, 52, 261 
parallel, 37 
plane, 40 
product, 241 
projection, 53, 261 
resolution of, 52 
row, 148 

scalar multiple of, 39, 42 
sum of, 39 

terminal point of, 33, 37 
unit, 37, 44 

vector space, 62 
complex, 62 
finite-dimensional, 96 
real, 62 

Wronskian, 238 

Zero vector 
in plane, 40 
in space, 40 
of vector space, 64 



Errata 


f.t. = from top 
f.b. — from bottom 


Page 

Line 

In place of 

Read as 

4 

6fb. 

page 3 

page 4 

5 

1 f.t. 

zz 1 2z f 2r 5=0 

zz -1- 2z + 2z -5 = 0 

8 

6fb. 

... because x - y ... 

. because x — x ... 

11 

1 fb. 

B -( .. } 

...B- {... } 

12 

6 f.b. 

s called ... 

is called ... 

14 

5 f.t. 

. ./; 1C -> jc® ... 

... /: X 1— »> X* ... 

16 

8 f.b. 

. Problems 4 and 5. 

... Problems 3 and 4. 

16 

7, 6 f.b. 

. . Problem 4 are one-one 
and which onto. 

... Problem 3 are one-one 
and which are onto. 

18 

13 f.t. 

... elements (x, y) ... 

... elements x, y ... 

20 

7 f.t. 

... real numbers. 

... integers. 

20 

8 f.t. 

... Z X Z ... 

... Z X Zo ... 

22 

9 f.t. 

In all these four examples 
of groups the operation 

IS commutative. 

In all the examples of 
groups listed above the 
operation is commutative. 

25 

9f.t. 

••• (/« f(gix)) 

= /(**) 

... (/««)W =yi8W) 

25 

19 f.t. 

... by 7{AR). 

... by IFM, R). 

26 

1 f.t. 

... function x x® jc -f- 1 ... function x i— ► x* 

+ X+ 1 

26 

2f.b. 

... function 1/2 sine ... 

... function (1/2) sine ... 



page 

Line 

In place of 

Read as 

’0 

6 f.t. 

II 

1 


44 

13 f.t. 

... by H and v. 

... by H and -w. 

4S 

1 f.b. 

.. 0 < 8 < ir ... 

... 0 < 0 < 7C ... 

49 

4f.b. 

... (fli, iU) ... 

... (a., fl») ... 

51 

20 f.t. 

... (or n ... 

... (or ig ... 

54 

19 f.t. 

... follow 

.. follows 

83 

3 f.b. 

... G y- ... 

... G y, ... 

85 

8 f.t 

... in (7.’0,2). 

.. in ^ (0, 2). 

92 

3 f.b 

1(1, 1.0). -1(0, 1.1) . 

1(1, 1,0) - 1(0.1,!)... 

96 

10 f.t. 

... because {vj, .. , n„} . . 

. . because {i>i v„} ... 

97 

10 f.b. 

Take F G K. 

Take v G K. 

97 

8 f.b. 

v„ .... v„say V, ... 

>’s. Vj, ..., V,. V ... 

99 

2 f.b. 

... exists any nonzero ... 

... exists a nonzero ... 

100 

1 f.t. 

... is u; otherwise ... 

. is 1 1; because 

otherwise ... 

102 

11 f.t. 

The reverse in equality ... 

The reverse inclusion ... 

102 

22 ft. 

dim Vj - (xj’-plane) 

I ... 

dim Kj “ dim 

(.xy-plane) + 

120 

1 f.b. 

1" ... 1 

+ =• 0 

7(v„+iU«.i -1 ... + »,Up) 

= 0 

126 

3 f.t. 

(3'l + ^3 "i ••• 

(J'l + 3'3)«X + - 

126 

2nd row 
in Table 
4.2 

ei - e 

Cl - c* 

133 

7. 8, 11, 
28 f.t. 

SoT 

(A' 0 7) 

151 

last entry 
of 2nd 
matrix 

-f 

_* 

4 

167 

3 f.t. 

r3 on 

JfA^I 1 

Ll -IJ 

r 3 on 
« 1 1 
L-l -IJ 


Page 

Line 

In place of 

Read as 

174 

22 f.t. 

... + X* ... 

... + X, ... 

181 

4f.t. 

... and -= ... 

... and ... 

182 

3 f.b. 

... iA)r (A^). 

- = (Aff 

187,188 


The 7x11 matrix on page 
line 9 f.t. of page 188. 

187 should be read after 

190 

1 f.b. 

“21 *32 *33 *34 

*31 *32 *33 *84 

251 

13 f.t. 

= Aiu, 

= ^(«i) = 

267 

12 f.b. 

u Au ^ 

u^Au — k. 











